Guild icon
S3Drive
Community / general
For all on-topic discussion about S3Drive or related storage providers.
Avatar
Hello guys and welcome to our Discord channel. In case you have any questions, problems, ideas or would like to simply talk about the app, S3, syncing and all that stuff... we would love to hear from you. 🚀
Legar joined the server. 1/30/2023 4:41 PM
Avatar
Avatar
Legar
Click to see original message
Avatar
Hi there, how do you feel being the first to join? 🙂
Avatar
It was a good idea to create a discord channel. Interactivity was very limited. This will improve the feedback loop
4:42 PM
Hahah feels good 🙂
Avatar
I need to get my community management skills up to speed, in the meantime let's give a Discord channel a try and see how it goes. I hope actually to get more feedback here. Well, thanks for joining !
🚀 1
Avatar
Today we've released support for video thumbnails and enlarged thumbnail, so it uses up the full square space. It's already available on Android, on iOS is pending release and will be available later today / tomorrow. How do you like it? (edited)
barrrrtek joined the server. 1/30/2023 7:35 PM
H10ISBFYAKE91 joined the server. 2/5/2023 7:52 PM
Avatar
Welcome to our channel @barrrrtek and @H10ISBFYAKE91 !
myfrogger joined the server. 2/13/2023 7:57 AM
Avatar
Hi, looks like a cool project. I can't seem to run it on windows because I get the error that files are missing. Any thoughts? The code execution cannot proceed because MSVCP140.dll was not found. repeated error for VCRUNTIME140.dll & VCRUNTIME140_1.dll
8:00 AM
Also, what is the recommended installation directory? It seems to be installing into %APPDATA% but I tried it in Program Files also. Both gave me the above errors.
Avatar
Hi, @myfrogger thanks for letting us know about the issue. It seems that Visual C++ Redistributable package may be missing in your system: https://www.microsoft.com/en-gb/download/details.aspx?id=48145 What Windows version are you running exactly? https://support.microsoft.com/en-us/windows/which-version-of-windows-operating-system-am-i-running-628bec99-476a-2c13-5296-9dd081cdd808 There is no preference as where you install the package. We're using default settings of: "Inno Setup", but in principle you can install it wherever you want. Finally, sorry for this issue, we're Linux users ourselves and we're working on improving tests and setup instructions on different desktop platforms, Windows included. (edited)
The Visual C++ Redistributable Packages install run-time components that are required to run C++ applications built using Visual Studio 2015.
Learn how to find which version of Windows operating system your PC is running and device specifications.
9:26 AM
@myfrogger Wait, did you actually use our "exe" installer or installed via Microsoft Store?
Avatar
Avatar
Tom
Hi, @myfrogger thanks for letting us know about the issue. It seems that Visual C++ Redistributable package may be missing in your system: https://www.microsoft.com/en-gb/download/details.aspx?id=48145 What Windows version are you running exactly? https://support.microsoft.com/en-us/windows/which-version-of-windows-operating-system-am-i-running-628bec99-476a-2c13-5296-9dd081cdd808 There is no preference as where you install the package. We're using default settings of: "Inno Setup", but in principle you can install it wherever you want. Finally, sorry for this issue, we're Linux users ourselves and we're working on improving tests and setup instructions on different desktop platforms, Windows included. (edited)
I used the exe installer as I hate the microsoft store. I'll try downloading Visual C++ now. I'm using Windows 10 Pro 22H2 (edited)
Avatar
No error messages now but when it loads I only get a black window
10:19 AM
I've uninstalled, reinstalled, and restarted
Avatar
Avatar
myfrogger
No error messages now but when it loads I only get a black window
Right, I've tried it on a fresh Win install and I also get a black screen. We're working on the fix and will let you know hopefully later today. Actually we've only reproduced it in a virtual environment and can't reproduce this on a physical environment. Black screen so far appears to be an issue with the GPU / hardware acceleration / DirectX version (at least 11 is required). (edited)
Avatar
Avatar
myfrogger
No error messages now but when it loads I only get a black window
May I ask what's your graphic card model? Is it dedicated or perhaps integrated within your CPU / motherboard?
k4ufj2 joined the server. 2/13/2023 12:16 PM
Avatar
It's integrated graphics
Avatar
Avatar
myfrogger
It's integrated graphics
Thanks that helps, do you perhaps have DirectX (at least 11) installed?
12:22 PM
It can be checked typing: dxdiag in the search bar.
Avatar
Actually I'm also testing your software in a virtual environment using Oracle VirtualBox so maybe that's the issue
Avatar
Right, so in fact that's an issue with VirtualBox, we're using latest 7.0.4 and it doesn't work. It works fine on VMWare Workstation though. (edited)
12:25 PM
App does require 3D acceleration due to technology that we're using (Flutter), perhaps it's possible to start it in a software acceleration mode only, but we haven't explored that yet. (edited)
Avatar
Gotcha. I'll try to test this soon on a physical computer. It doesn't seem to have any bloatware installed so I should be safe. It's incredibly difficult to find good backup and sync software if you want end-to-end encryption and using a S3 based cloud
12:26 PM
This idea is very, very cool though it wasn't what I was initially searching for. Those are the best finds though 🙂 🙂
12:27 PM
People upload FAR to much data to hosted clouds. I uploaded business "trade secret" data for work to dropbox for years...what a disaster that could have been! I was so ignorant
Avatar
Thanks for the good words. It keeps us motivated 🙂 We're pending major release with multiple new features being added. It will also include photo backup from Android/iOS to S3. Different sync modes including two-way sync will be available ~April 2023 - https://s3drive.canny.io/feature-requests/p/syncbackup-options-two-way-one-way
Avatar
That's an amazing idea. Actually I uploaded all my photos to the cloud up until recently out of ignorance also! Then I switched to Mega.io but recently scrapped the whole thing and decided to sync only to my laptop, which is then backed up in a more secure way. Photo backup is a major upgrade and very useful!!
12:31 PM
I don't know why but I've seen on other apps it's hard to make automatic backup triggers on iOS. It seems the main way people do it is based on GPS movement. I didn't want to give apps my location. The other way I've seen recently is auto sync is triggered upon the device connected to a charger. That's better but I've seen only used on one app.
12:32 PM
Maybe you know other ways but to my non-technical research brain, auto syncing on iOS seemed like a real obstacle for developers.
Avatar
It's quite tricky to do it reliably on iOS and so far the backup mode will work for S3Drive when you start the app (comparing to fully supported background sync on Android)... but then we will be using all available means to improve that. Thanks for the hints with triggers.
Avatar
So if you run into that problem, maybe try the sync when connected to a charger
Avatar
In fact it's quite tricky to do it reliably on Android as well due to: https://dontkillmyapp.com/
Hey Android vendors, don’t kill my app!
👍 1
Avatar
Avatar
myfrogger
So if you run into that problem, maybe try the sync when connected to a charger
It's possible that it needs to create an iOS shortcut in the "automation" section. Another iOS approved trigger might be to connect to a certain wifi
Avatar
Given that iOS ecosystem is a pretty new thing to me and our team these hints are extremely useful !
Avatar
I thought it might be. It's surprisingly hard to find solutions as a user if I don't want to trust the company also with my data. It seems most people want an all-in-one solution so who knows
12:38 PM
I mean, who knows what most people want. I don't think I'm the usual customer and there's not enough people like me to make lots of money
Avatar
I was personally struggling to find such solution. That's actually how this project started.
🔥 1
12:40 PM
I actually don't like all-in-one. I prefer to choose best tools for specific case.
12:40 PM
Most people do prefer all-in-one though as you say.
12:40 PM
Great, I'd love to hear if you managed to install the app and whether it works all fine for you.
Avatar
I'll keep you updated in a day or two when I have more time 🙂 Thanks for your help!
Avatar
Thanks for your feedback !
shaike joined the server. 2/13/2023 7:08 PM
7:09 PM
Does a3 photosync supports syncing video files or just photos?
Avatar
Hi @shaike, it supports both video and photos, however by default only photo albums upload is enabled, video albums needs to be explicitly marked for auto upload.
Avatar
Where can i gind itcon photosync s3? It shows me DCIM and WA business folders
7:37 PM
Sorry for typos
Avatar
That's how it looks on my end. There is Movies folder.
7:40 PM
Then I need to unhide it.
Avatar
I am talking about photosync not s3 drive
Avatar
This is PhotoSync screenshot.
7:41 PM
Depending on the Android version these folders are named differently, but in principle rule is the same.
Avatar
Right, is that everything that you see? No more albums?
Avatar
This is what i see
Avatar
So no videos
Avatar
I am not sure why videos are not displayed. Within a week or maximum two, there will be Early March we shall deliver photo & video module (with a backup and background mode) to S3Drive with more flexible album management. This is where our focus is currently. BTW. What's your phone model / Android version? (edited)
Avatar
Fold 3 with android 13 oneui 5 December 2022
7:48 PM
That's will be grear
7:48 PM
Great
Avatar
Thanks for letting me know. I need to say that we haven't tested PhotoSync with Android 13 enough, instead we worked hard on S3Drive. If you don't mind waiting little bit I would recommend trying it once the backup module is released. Sorry for the inconvenience.
Avatar
That's fine i really appreciate your work
7:52 PM
So i should use s3 drive meanwhile?
Avatar
It can't automatically backup your media, so it's not a replacement for PhotoSync just yet... but in general if you want to interact with S3 then S3Drive is the way to go.
Avatar
Ok will do acctually i just want to clear some space. But since i had too many files on found that s3drive couldnt handle it
7:55 PM
By the way does s3 drive will supported multiple buckets available?
Avatar
Given that we released first version in December, there is plenty of work ahead of us and lots of improvements deployed weekly.
7:56 PM
Multiple buckets support will come in a next earliest release, which is scheduled mid this week. (edited)
Avatar
Great thanks for the great work
Avatar
Thanks for the good words. It's been crazy past few months, but comments like this make my day and give me motivation to push hard on this 🙂 (edited)
Avatar
Avatar
shaike
Ok will do acctually i just want to clear some space. But since i had too many files on found that s3drive couldnt handle it
@shaike You did say that S3Drive couldn't handle lots of files. There is a known issue if too many files are being downloaded / uploaded simultaneously (there is no hard limit which might make app crash), but as such the front-end should handle buckets with lots of files. What problems you were facing in more detail if I can ask? (edited)
Avatar
I have tried to upload about 6000 files and it just crashed
Avatar
Avatar
shaike
I have tried to upload about 6000 files and it just crashed
I see, right, it won't work just yet, but we're working on this as one of the high priority items with ETA end of February / early March. Once it's there we will then be able to support folder upload which will come next.
Avatar
Good to hear
8:05 PM
Good luck
👍 1
Avatar
Any idea why Backblaze is refusing my connection?
12:55 AM
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
Avatar
OOPS. It appears I need to enter https:// But what's interesting is that the computer was actually sending network traffic. Maybe it's defaulting to HTTP? So backblaze was rejecting all HTTP traffic but accepted HTTPS? (edited)
2:02 AM
A significant downside is that the file and folder names are not encrypted 😦
2:03 AM
This is especially important to me because I like to use very descriptive file names.
2:06 AM
Next, when I try to create a share link, I cannot uncheck this box nor edit the date/time for link expiry. Do I need to make my S3 bucket public by chance? (edited)
Avatar
Even with the bucket set to public the link doesn't work for me (edited)
Avatar
Hi @myfrogger, you're right if no scheme (https/http) was provided it defaulted to HTTP. We're going to make more explicit. Likely the endpoint without scheme will default to https, where as IP addr will default to http. Filename encryption is on our Roadmap and we have a working prototype already. https://s3drive.canny.io/feature-requests/p/filenamefilepath-encryption (ETA ~April 2023). We're making further research to understand standards or well established implementation in that area, so we can stay compatible. The sharing functionality is based on S3 presign URLs, their limitation is that the signature can't be valid longer than 7 days, so every 7 days new link would have to be generated. We're researching how to overcome this limitation. For instance we could combine this with a link shortener, so there is single link that doesn't change, but under the hood we would regenerate the destination link as needed. The encrypted share link has the master key at the end after the # character and looks like this: https://s3.us-west-004.backblazeb2.com/my-s3drive/.aashare/hsnwye5bno3p/index.html?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=004060aad6064900000000044%2F20230214%2Fus-west-004%2Fs3%2Faws4_request&X-Amz-Date=20230214T095014Z&X-Amz-Expires=604800&X-Amz-SignedHeaders=host&X-Amz-Signature=abdcd875e2106ee54c6a1d1851617c7e694e121464c5ca9023526ce2836be595#GKSGYX4HGNAd4nTcXb/GIA== What it does it tries to load the encrypted asset as usual, but it's not aware per se if an asset is encrypted. In the background JavaScript tries to fetch the asset and replaces the one on the screen with decrypted version. It looks like it has failed on your side. Can you go to the console (right-click -> inspect element) to see if there is anything abnormal (that is error in the Console or different than 200 status code in any of the network requests).
Avatar
The current sharing functionality is pretty basic version initially introduced in PhotoSync. We actually plan to integrate it with our web client, so when you share a link, it would open normally inside the app: https://web.s3drive.app It's not on our roadmap yet, we need to build some spec first. Realistically we won't be able to build it earlier than June/July. Speaking of your file / image sharing issue. Does it work unencrypted? What size is it? Bucket doesn't need to be public (it shouldn't be). The idea of presigned sharing is that you choose which resource to share from a private bucket. I would be glad to assist you on any other issues. As you see, it's all pretty early stage, but we're catching up fast. Thanks for your feedback and an idea with listing buckets button. Noted and added to our improvement items. (edited)
Avatar
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
Avatar
Can I ask a general S3 question? Are there any implications of backing up say, 10000 files at 250kb each or a few larger zipped files? Before I came across S3Drive, I was actually looking for more permanent backup solutions. There are two different approaches that I see and I don't know if one is better than the other. One is storing each file individually and the other is first putting them into "chunks" of X MB/GB first.
Avatar
Avatar
myfrogger
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
2. Period can be shorter than 7 days. We just didn't implement it yet. 3. That's right, as usual there are ways around, but not all of them feasible for S3Drive. It's possible to revoke credentials and generate a new ones, that would invalidate the link, but that's not practical if user have to do it themselves. The other option is to change the resource / filename, that's also quite impractical. The most feasible option that we've researched so far is connected to E2E encryption. Basically revoking share would mean regenerating sharing key for that resource. That means that presigned link would still be valid for some time, but the adversary would only be able to get the encrypted blob. We're still researching this. 4. This project started in Summer 2022 just as an Android app to backup Photos to S3 - https://play.google.com/store/apps/details?id=com.photosync.s3 (actually month earlier it was just Backblaze - https://play.google.com/store/apps/details?id=com.syncsolutions.backblazesync). Lots of research was already done in order to implement them. S3Drive extends that on all file types and all platforms. 5. Yeah it's rough around the edges, but in principle works for the most persistent users. We'll improve that. 6. We didn't even go as far, but the right click context menu (and tray icon with options like auto-startup etc.) is definitely something we would be adding. Thanks for mentioning that. I will make sure it's added to our list. Speaking of favicon, logo and UI in general. That's something that received least amount attention, since we were focused on building all the blocks to validate the concept. Now we keep adding new features and deploying bugfixes / improvements. There will be a moment within a few months at least where we step back and focus on UI simplification and beautifying. Do you have any ideas what favicon would work better? Thanks ! (edited)
Avatar
Avatar
myfrogger
Can I ask a general S3 question? Are there any implications of backing up say, 10000 files at 250kb each or a few larger zipped files? Before I came across S3Drive, I was actually looking for more permanent backup solutions. There are two different approaches that I see and I don't know if one is better than the other. One is storing each file individually and the other is first putting them into "chunks" of X MB/GB first.
It's finding a sweet spot between usability, costs and performance. For instance minimum billable object size for AWS S3 is 128KB, that means that if you store smaller objects you're still paying for the full 128KB. Smaller files means also more requests which will likely degrade performance and increase API costs (e.g. https://www.backblaze.com/b2/b2-transactions-price.html). S3 protocol doesn't support bulk upload (it does support bulk delete though), so 10000 files means at least 10000 PUT requests. On the other hand if you compress files and store them as chunks of X MB/GB, then even if small 250kb file is being changed, you need to replace the whole chunk which also comes at some price. If it's a cold backup that you synchronize from time to time, then having some sort of block storage (https://github.com/archiecobbs/s3backer) / chunks might be preferable way. If you want to conveniently access your data and even have a working copy that you work with, then a standard file approach is preferable even if it comes at some cost. S3 has its limitation, but it's powerful protocol, soon we will be supporting Versioning (https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash). Perhaps over the time S3 protocol will further expand allowing new operations (including bulk ones). If not, we have some ideas how to overcome some of the S3 protocol limitations with a "convenience proxy" that we're also researching, but not everything at once 🙂 (edited)
🙏 1
Avatar
Avatar
myfrogger
You guys are awesome!! Thanks for all your hard work. I do see that you catch up very quickly 🙂 1. I'm happy to hear that folder name and file name is on the near roadmap for completion. Usability problem solved 🙂 2. The S3 presign URL concept is interesting. Can a link be done for a time period shorter than a week? I assume the user would need to have their program opened and some kind of timer to check if any links need to be signed again. Then the shortened link would need to be updated. It's a good idea actually but would want to make sure it's done in a trustless or trust minimized way. Also be careful deploying resources that you have to pay for as then you'd have ongoing costs. It depends what your monetization plan is long term I guess. 3. If the link is presigned, am I right to assume that there is no ability to revoke the sharing? 4. I'm actually not familiar. What is PhotoSync? 5. The link appears to work fine in Chrome but in Firefox it stops loading the page faster. If I click refresh, the image appears as it should. Strange but seems like all is fine. The things I would typically be sharing are not photos so it's not really a priority issue for me. 6. I'd love it if S3 drive had a different favicon so I can more easily distinguish it. I'd love it more if it was mounted as a drive letter in my file explorer. 😉 Actually, I think what I'd personally use most is if I could right click, go to "send to" and have S3 drive as a destination. I'd have to think about if I'd want it in the main folder or prompt me where to put it. I'd probably choose to have a popup to prompt me where I want it saved within S3 drive. (edited)
The drive letter / mount is something we've already tried and had a working read-only prototype on Linux. https://s3drive.canny.io/feature-requests/p/file-mount-on-desktop-clients-with-write-support Mac and Linux will likely be supported end of Summer using FUSE driver that we're already tried. With Windows we haven't explored it yet, but there are some ways to do it (https://github.com/winfsp/winfsp). We'll definitely implement it, it's just at this stage it's hard to give us ETA. We might adjust priorities later on depending on the users percentage per platform, but we don't have a clear view / analytics to make that decision just yet. What platform are you using by the way?
Avatar
Thank you for the detailed responses. I'm using I use Windows and iPhone. My initial thought with the favicon is the current folder with the letters S3 on it. I'd have to do a bit of thinking and asking around at identifying the target market for this product. I'm not even sure S3Drive is the best name for marketing purposes. I don't dislike it though; just rambling. As far as those coming from Dropbox, Onedrive, etc, etc.... I think that the E2EE/control or own your data is a significant selling point and also the "pay for what you need". I don't know why all these companies have different "packages" when it seems easier to onboard people to a pay-as-you-go model. Apple seems to be the only one that figured it out that millions of people don't care about a $0.99 fee but they do care about $5-10. I think that you could monetize by having your own built in cloud (simply putting everyone's data into your own BackBlaze or Wasabi account). At least then when someone downloads the app, there is a usable setting without any further configuration. Maybe offer X 50gb free storage like everyone else. I remember reading years ago that getting someone to use the app the moment they download it is critical to keeping them as a user. I think you should embrace accepting bitcoin, lightning, and maybe some other crypto payments. Also embrace the community that wants their data private. Don't ask for names, don't log their details, etc. For cards use stripe. Maybe this not a project that you'll monetize but I feel like this could be a full time job, and an opportunity to make a great product that people would pay for. Anyway---I agree with you that you can't do everything at once, and the priorities appear to be ordered in a logical way. Keep up the good work 🙂 I'm happy to be an early user and maybe able to contribute somehow along the way. (edited)
Avatar
Just realized there are concerns with sharing data because idiots will share illegal material. Maybe stay out of the business of hosting the data for now. I'm just thinking out loud but I'll leave the above writing there in case anyone finds it helpful.
Avatar
Avatar
myfrogger
Thank you for the detailed responses. I'm using I use Windows and iPhone. My initial thought with the favicon is the current folder with the letters S3 on it. I'd have to do a bit of thinking and asking around at identifying the target market for this product. I'm not even sure S3Drive is the best name for marketing purposes. I don't dislike it though; just rambling. As far as those coming from Dropbox, Onedrive, etc, etc.... I think that the E2EE/control or own your data is a significant selling point and also the "pay for what you need". I don't know why all these companies have different "packages" when it seems easier to onboard people to a pay-as-you-go model. Apple seems to be the only one that figured it out that millions of people don't care about a $0.99 fee but they do care about $5-10. I think that you could monetize by having your own built in cloud (simply putting everyone's data into your own BackBlaze or Wasabi account). At least then when someone downloads the app, there is a usable setting without any further configuration. Maybe offer X 50gb free storage like everyone else. I remember reading years ago that getting someone to use the app the moment they download it is critical to keeping them as a user. I think you should embrace accepting bitcoin, lightning, and maybe some other crypto payments. Also embrace the community that wants their data private. Don't ask for names, don't log their details, etc. For cards use stripe. Maybe this not a project that you'll monetize but I feel like this could be a full time job, and an opportunity to make a great product that people would pay for. Anyway---I agree with you that you can't do everything at once, and the priorities appear to be ordered in a logical way. Keep up the good work 🙂 I'm happy to be an early user and maybe able to contribute somehow along the way. (edited)
@myfrogger You're absolutely spot on. We're researching what cloud we could use or whether we need to build our own one (likely MinIO based). Ideally we would pay predictable amount for the resources and resell it at some margin as a complete solution back to the users. The issue with Wasabi, Backblaze and many other clouds is that we can't control the costs as a business (there are many components) and can't easily specify quota per user account, so we don't bankrupt if one user decides to abuse the S3 credentials. Building own cloud on the other hand is additional chunk of work that we would like to avoid, more importantly it comes with huge responsibility, some legal burden and maintenance costs (infrastructure updates, security fixes, SLA, outages, on-call...). We'd also like to leave a room for power users which would like to use their own S3 back-end, so we're not locking anyone with our ecosystem. ~90-95% users would likely use our default offering, because it's convenient, but if someone would like to set up their own MinIO instance using their NAS or whatever, then go ahead. We'll come back to that, but first priority is to build a stable S3 protocol clients. I would love this to be a full-time gig, at the moment it is a full time volunteering and won't be source of income for long, but that's fine. I am extremely excited building technology which helps people to keep their data private without giving it up to seemingly "free" alternatives. It's quite challenging explaining people that "free" software that they use it's actually not free (they pay by their data being sold and mismanaged), these very same people will say: "I've nothing to hide", they're majority and not a target of our offering. There is still significant community of people who actually do mind protecting their privacy. I would rather stay in that circle. ... and I am glad to have a users like you who open up and give proper feedback. Thank you ! (edited)
🚀 1
Avatar
Avatar
myfrogger
Just realized there are concerns with sharing data because idiots will share illegal material. Maybe stay out of the business of hosting the data for now. I'm just thinking out loud but I'll leave the above writing there in case anyone finds it helpful.
As long as a business provides an easy way for DMCA to take down the copyrighted material I think it should be fine. (edited)
👍 1
Alisa joined the server. 2/16/2023 4:28 PM
Avatar
Hi @Alisa Welcome here 🙂
Avatar
Avatar
myfrogger
Hi @Alisa Welcome here 🙂
Hey:)
Avatar
Since 1.1.1 there is an improved upload performance (using multi-threaded workers), as well as additional functions in the Transfers section. Previously uploading ~100+ files could crash the app depending on the machine. Currently ~1000 files is a piece of cake. We've tested ~11k and except that scrolling the items isn't exactly a smooth experience, it's uploading just fine. It is possible to retry the failed requests with the retry arrow. There are also bulk operation buttons to stop all and delete all items within the tab you're in. (edited)
9:29 AM
9:29 AM
Waiting list
9:30 AM
Failed ones (auto-retry will get there in one of the next releases) (edited)
Avatar
Awesome!!! Great work 🙂
👍 1
Tillerson joined the server. 2/26/2023 10:40 AM
Avatar
Hi @Tillerson !
10:41 AM
Welcome to our modest community 🙂
Avatar
hello
stefanc12 joined the server. 3/1/2023 11:59 PM
stca joined the server. 3/2/2023 12:03 AM
Avatar
Avatar
stefanc12
Click to see original message
Avatar
Hello, I am trying the photosync for s3 and I'm getting invalid url on the generated access key
Avatar
made it work - I had to add https:// in front of it
12:53 AM
Trying S3Drive with the same but cannot connect
Avatar
Hi @stca and welcome to our channel. We've recently added the photo & video backup module in our S3Drive app which is now recommended way of interacting with S3 endpoints. If you would like to keep using PhotoSync you're free to do so, however going forwards we're actively expanding S3Drive. Thanks
12:51 PM
Hi @stefanc12 and welcome to our channel ! 👋 (edited)
Avatar
Hi @Tom thanks. I've already switched to s3Drive but that one cannot connect to my idrive s3 ... not sure what to do, I think I've tried everything ...
10:21 PM
I'm interested in the premium version with encryption. Quick question: can I also decrypt the files with some standard command or software?
Avatar
Avatar
stca
I'm interested in the premium version with encryption. Quick question: can I also decrypt the files with some standard command or software?
Encryption is compatible with V2 client-side cipher that AWS introduced. I am not aware of CLI that supports it, but it is supported by AWS SDK's, please search table for "Content Encryption: AES/GCM" and "Key Wrap: AESWrap"(https://docs.aws.amazon.com/general/latest/gr/aws_sdk_cryptography.html#crypto_features) which is supported by Java, .NET, Ruby V2, and C++. We haven't published any script or CLI tool yet, but we will provide one as an open-source, so user can always download and decrypt data at their discretion. We haven't prioritized that yet, as due to some limitations of both AES-GCM and AWS approach, we're having problem with implementing encrypted video streams and considering switching to different cipher and/or encryption scheme: https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos (edited)
Avatar
Avatar
stca
Hi @Tom thanks. I've already switched to s3Drive but that one cannot connect to my idrive s3 ... not sure what to do, I think I've tried everything ...
I've tried connecting to iDrive myself and it worked just fine. Do you get any specific error? What endpoint are you using (I got e.g.: https://f4n6.par.idrivee2-46.com) ? Can you please long tap on version number at the bottom of the login screen, so you go to the Logs and perhaps see some error or warning that might render something useful? (edited)
Avatar
Multiple issues: (a) can't verify the secret key (the other app has a view button) (b) can't place cursor to add or delete a letter (c) not clear if I need to add the https:// part to the endpoint string
12:25 PM
I get "Failed to authorize"
12:25 PM
same credentials worked on the other app
12:26 PM
endpoint looks similar to yours
Avatar
Avatar
stca
same credentials worked on the other app
Regarding a) We will add such option, thanks for mentioning that. b) That's something we can't easily reproduce. What's your Android version and phone model? c) Both: "https://f4n6.par.idrivee2-46.com" and "f4n6.par.idrivee2-46.com" would behave the same and use secure HTTPS context. Quick question, does the API key that you generate have both: "Read and write" permissions? S3Drive verifies the credentials, by saving a small test file to the bucket.
Avatar
For b) I have an Samsung S22 Ultra.
2:33 PM
Android 13
2:33 PM
It is read/write ... Photo sync did save files with same account
2:34 PM
And it also works on syncaware ...
Avatar
Avatar
stca
endpoint looks similar to yours
I've managed to reproduce the "Failed to authorize" issue once: "Default encryption" is enabled for an iDrive bucket. It seems that they've implemented encryption in a way which modifies the ETag / MD5 hashes on the S3 protocol side. S3Drive performs strict ETag validation which is required for not yet released syncing features. After we write an object to iDrive E2, we expect ETag to match content of file that we've sent to the server (file integrity), instead they seem to return ETag of their encrypted blob. We will think of workaround, e.g. by disabling syncing features (and notifying user) if we detect ETag issue instead of preventing user from logging in by displaying: "Failed to authorize", however before it's there the only way is to disable iDrive encryption. https://s3drive.canny.io/feature-requests/p/workaround-idrive-e2-auth-issue-if-default-encryption-is-used PhotoSync doesn't perform ETag validation, since it's only one-way upload. Technically speaking the iDrive approach isn't correct from an S3 protocol perspective and is unique amongst S3 providers, e.g. Backblaze's encryption works just fine. Thanks for reporting this issue ! (edited)
👍 1
Avatar
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Avatar
Avatar
stca
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Thanks, I know it's indeed painful with 4 details to be provided. There will be improvement coming within a few weeks. We've already implemented QR code auth in our previous app (PhotoSync). The old web client does indeed support that: https://web.syncaware.com (edited)
Avatar
Avatar
stca
there's gonna be a better way to connect to the account with QR code or something like on the web instead of typing all that ... Maybe with a small tool to generate the QR code or something ...
Basically the idea is that desktop or web will display QR codes, which then mobile app will scan and securely (encrypted !) provide the credentials over.
Avatar
I've signed in after disabling the idrive default encryption as you've indicated
👍 1
1:21 PM
not sure how to transfer a folder?
1:22 PM
is album thumbnail view enabled?
1:22 PM
or is it only for media backup?
Avatar
Avatar
stca
not sure how to transfer a folder?
It's not yet possible, but eventually will be.
👍 1
Avatar
Avatar
stca
or is it only for media backup?
Initially it's media backup only preview functionality.
Avatar
Avatar
stca
or is it only for media backup?
By saying thumbnail view, you mean grid view?
Avatar
can i select which media?
1:23 PM
i.e. camera album ...
Avatar
Avatar
Tom
By saying thumbnail view, you mean grid view?
yes
Avatar
Avatar
stca
can i select which media?
You can upload: "All" media from select album/albums or "Only new", there is a dialog prompt the moment when album is selected. In next turn we will implement manual mode where you can manually select media to backup (or conversely mark them "fresh" for reupload).
Avatar
Avatar
stca
yes
Yes, we might actually kill the current view, since filenames + list isn't condensed enough for bigger albums. The issue is that on iOS there is no way to reliably get the filename for display anyway, so we'll likely default to thumbnail / grid view. (edited)
1:28 PM
There is an active development on all this, it's all coming. Bear with us please and stay tuned 🙂
Avatar
Avatar
Tom
Yes, we might actually kill the current view, since filenames + list isn't condensed enough for bigger albums. The issue is that on iOS there is no way to reliably get the filename for display anyway, so we'll likely default to thumbnail / grid view. (edited)
👍
1:29 PM
after upload preview is not working for me (I have added an encryption key) (edited)
Avatar
Avatar
stca
after upload preview is not working for me (I have added an encryption key) (edited)
Is it a photo or video?
1:31 PM
actually I only have the thumbs folder
1:31 PM
I'll check on idrive
1:32 PM
yup ... only the thumbs folder exists (edited)
Avatar
What are your numbers here after backup has finished? Is media that was supposed to be backed up media appearing in: "Backed up" counter?
Avatar
it says 2 and 2
1:38 PM
2-2-0
1:38 PM
But I have another issue, in that folder/album I believe I should only have 2 photos
Avatar
Great, so when you navigate to Root folder, can you see: Automatic uploads folder?
Avatar
when I go in it I see pics I have just received in whatsapp
1:39 PM
Root folder of?
Avatar
Basically Top of the Files section.
Avatar
there is no no, I don't see that
1:39 PM
but auto upload is not enabled
1:39 PM
I used "Start backup"
1:40 PM
now in the album I see 2 files only
Avatar
That's fine, since your numbers claim that media was backed up, it should be there. I am wondering if it has something to do with iDrive read consistency.
1:41 PM
Album tab shall display all pictures. There are two annotations, green (backed up) and white cloud (not backed up yet), no annotation mean media is not selected for backup.
Avatar
some strange things are happening ... files appear in the root
1:42 PM
then disappear ...
1:43 PM
the 2 photos show as backed up
Avatar
... but have you seen Automatic upload folder at least once?
1:43 PM
I can enable the auto backup to see
Avatar
It won't change anything really. It's just poor name of mine, the automatic upload folder is where the backed up media are supposed to appear regardless if it's user clicking "Start backup" or if auto mode is enabled (edited)
Avatar
says: app needs to be running, background service will be available soon
Avatar
What do you mean that files appear in the root? You mean like just at the first top level in the Files tab? (edited)
Avatar
Avatar
stca
says: app needs to be running, background service will be available soon
That's right, background service is being worked on. PhotoSync had that, we can do the same here.
Avatar
in the listing ... a screen refresh or cache issue??
1:47 PM
now they are not there anymore
1:47 PM
I should take a screenshot if it happens again
Avatar
That looks to me like hitting different iDrive server every refresh which have different version of cache. We haven't used iDrive actively really.
1:47 PM
Never experienced that with Backblaze for instance.
Avatar
could be ...
Avatar
I am still worried that Automatic uploads folder isn't displayed, as this is where files are supposed to be uploaded. We will allow overriding that location by user in the Settings, but it's not there yet.
Avatar
Avatar
stca
could be ...
I've found this topic on Reddit, which in general highlights multiple issues that iDrive E2 is having. https://www.reddit.com/r/selfhosted/comments/vyu2c7/comment/iw0pgdx/?utm_source=share&utm_medium=web2x&context=3 One of them 4 months ago: "It’s impossible to access newly created folders" I am not claiming that this is what's happening, as there well may be an issue on our side (we're still beta). Is it possible by any chance for you to switch to e.g. Backblaze or other provider at least temporarily? (edited)
Avatar
I suppose it is ... but I am in no hurry
Avatar
maybe I can try the MinIO instead ...
Avatar
Avatar
stca
maybe I can try the MinIO instead ...
MinIO is great, however ironically with the default settings using their Docker image we've faced similar listing cache issues (LS command was returning stale objects which were not fetchable via GET method), we have it in our backlog and didn't have chance to investigate since priorities are elsewhere. I guess it must be related to default cache settings which are maybe performance focused. Let's be honest, S3 protocol implementations for a long time weren't suitable for thing like S3Drive, due to consistency issues which were addressed not that long time ago. For AWS it was December 2020: https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/
exploit joined the server. 3/7/2023 6:35 PM
Avatar
Avatar
exploit
Click to see original message
Avatar
Hello 🙂
7:10 PM
Any idea how to fix this? Encryption is enabled
Avatar
Hi @exploit, thanks for your post. I assume that's an Android? Can I ask you what's your OS version and phone brand/model? Does it happen for every file during upload? (edited)
Avatar
Avatar
Tom
Hi @exploit, thanks for your post. I assume that's an Android? Can I ask you what's your OS version and phone brand/model? Does it happen for every file during upload? (edited)
Galaxy S21 Ultra, Android 13 (edited)
10:30 AM
Yeah since I enabled encryption
Avatar
@exploit Thanks, we're fully on this. We've managed to reproduce it on some low-end Samsung with Android 13. I will let you know later today about progress on this. Sorry for the inconvenience !
Avatar
Avatar
Tom
@exploit Thanks, we're fully on this. We've managed to reproduce it on some low-end Samsung with Android 13. I will let you know later today about progress on this. Sorry for the inconvenience !
No worries, I was just trying the app for the first time 🙂 (edited)
👍 1
Avatar
Avatar
exploit
No worries, I was just trying the app for the first time 🙂 (edited)
If you come across something else that's not working for you or it's not clear enough, I'd be more than happy to help.
💯 1
Avatar
Avatar
exploit
Yeah since I enabled encryption
We've addressed this issue in the 1.1.3 release which is currently pending review on the Play Store. I will let you know once it's Live (this usually takes between ~5-12 hours). Thank you very much for reporting this.
Avatar
Avatar
exploit
Any idea how to fix this? Encryption is enabled
This issue is now fixed, please update your app version. Thanks ! (edited)
🔥 2
FortyMarlin joined the server. 3/13/2023 11:48 PM
Avatar
Hi @FortyMarlin, welcome to our little world !
👍 1
Avatar
Keep up the great work Tom! This is turning into a better app every week!
👍 1
Avatar
How do i support this app? Is it for free?
Avatar
Avatar
shaike
How do i support this app? Is it for free?
App is entirely free. You're supporting us by simply using it, as you would likely report an issue, or perhaps might have some improvement idea. We're working on a sustainable business model, but at the moment we're focused on delivering remaining functionalities and moving it from (beta) to (stable). We'll be offering managed S3 accounts in Q2, but will always leave an option for a user to use their own S3 account. (edited)
Avatar
Thanks much
Avatar
Avatar
shaike
Thanks much
If you like the app, we would appreciate rating our app and/or leaving the review on App/Play Store. I think the idea behind the app is great and fits many uses cases, but we're pretty early and far from being a recognizable solution 🙂
Logarithm joined the server. 3/16/2023 12:41 AM
Avatar
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
Avatar
Avatar
Logarithm
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
@Logarithm Hi, thanks for joining. There are couple items here. Do you have an encryption enabled and use files bigger than 100MB? If so, then S3Drive uses much slower software encryption for such files which has visible performance effects, we plan to fix this, however since it's a topic of highly security sensitive nature, we're not rushing the decision. These are the roadmap items: https://s3drive.canny.io/feature-requests/p/explore-support-for-xchacha20-poly1305 and https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos which we plan to deliver around Summer 2023. If you upload/download multiple items without encryption enabled or smaller than 100MB and find poor upload/download speeds then switching to different S3 (Wasabi) might help, but only if you're not already maxing out your current internet connection. Deleting item is a different beast. Currently we're not deleting items, but rather "copy" them to trash one by one, and then delete files in the original location. It's not that delete is slow, but the "copy" operation takes time and it's safe to assume that "thousand" files operation will be roughly 1000x slower then a single file. What can help here is to switch to S3 provider/region that has closest proximity to your internet connection, but no matter what results won't be satisfying enough. No worries though, we plan to address this in ~April 2023 by adding support for native S3 versioning: https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash so we can actually skip Copy operation... and Delete itself is fast enough. (edited)
👍 1
Avatar
Avatar
Logarithm
I use StorJ but found that upload/download speeds can sometimes be abyssimal and requests to delete folders with many thousand items fail for no good reasons. I'm considering to move my data to Wasabi, thoughts?
I've just checked it and it seems that Storj doesn't support object versioning and I didn't find if it's on their radar to have it implemented. On the other hand Wasabi does support it: https://wasabi-support.zendesk.com/hc/en-us/articles/115001684631-Does-Wasabi-support-versioning-
Yes. The versioning feature with a cloud storage service offers an additional level of protection by providing a means of recovery when customers accidentally overwrite or delete objects. This allo...
👍 1
Avatar
Thanks mate!
Avatar
I left a 5 stars review for both apps hope it helps it rank high in search results
👍 1
3:36 PM
What is the UI coded in? React native or flutter?
Avatar
Hi, which S3 storage would you recommend to connect to?
Avatar
Avatar
FortyMarlin
Hi, which S3 storage would you recommend to connect to?
Hi, They all have slightly different pricing models, each of them being suited towards certain workflows. You probably can't go wrong with either Backblaze (PayG but transfer fees) or Wasabi (fixed plan, but no transfer fees). I didn't have technical problems with Scaleway (except some billing issues and requirement of using credit card instead of debit card). If you want fully "own" the data, then you can self-host MinIO, but this would only be cost-effective for bigger datasets or if you can afford setting it up on at your Home/NAS. I probably wouldn't recommend iDrive E2 (lots of technical issues and inconsistent behavior)... and with Storj I need to say I don't exactly know what guarantees they give, but you probably can't go wrong with free ~150GB (UPDATE: They've changed that to 25GB - https://forum.storj.io/t/storj-free-tier-update-for-new-accounts-25-gb-storage/22155) data plan just to try them out. No matter what, I wouldn't recommend using just one destination as the only backup of your data, but similar applies to Dropbox and alike. (edited)
👍 1
Avatar
Avatar
Logarithm
I left a 5 stars review for both apps hope it helps it rank high in search results
Thank you, it always helps !
Avatar
Avatar
Logarithm
What is the UI coded in? React native or flutter?
We're using Flutter and it works really well. All of the logic, networking, encryption is also built using Flutter / Dart... and if something can't be achieved with Flutter, then we call native platform functions. (edited)
👍 1
Avatar
Great choice
Avatar
Avatar
Logarithm
Great choice
Are you interested in a cross-platform development? There is also other promising project: https://kotlinlang.org/docs/multiplatform.html it wasn't mature enough when we started. EDIT: Apparently it's still in Beta. (edited)
Avatar
I have plans to work on kids mobile games but will probably orchestrate instead of code. I have some coding background but never loved coding much.
Avatar
Avatar
Logarithm
I have plans to work on kids mobile games but will probably orchestrate instead of code. I have some coding background but never loved coding much.
Well, I never loved coding as an isolated activity, but I find it extremely exciting when used as a tool to solve some real life problems. Good luck on your project ! (edited)
👍 1
Avatar
@Tom you think that Kotlin Multiplatform is mature enough to match Flutter? I couldn't find performance comparisons. It seems like Kotlin would be a good choice as it's a first class citizen for android too so you don't have to learn as many programming languages, but do they have rendering engines as good as flutter? I know flutter just released a new rendering engine for IOS that use metal, and their android engine is pretty good too.
Avatar
Avatar
Logarithm
@Tom you think that Kotlin Multiplatform is mature enough to match Flutter? I couldn't find performance comparisons. It seems like Kotlin would be a good choice as it's a first class citizen for android too so you don't have to learn as many programming languages, but do they have rendering engines as good as flutter? I know flutter just released a new rendering engine for IOS that use metal, and their android engine is pretty good too.
I don't think I am educated enough on Kotlin Multiplatform to answer that. I don't think that currently KMM maturity is near enough of Flutter, but specifics probably depends on the project. I think Kotlin has a better future than Dart though. I also liked working with Kotlin more... and the ecosystem is Java compatible, which means you have access to decades of knowledge and different projects. EDIT: It's not exactly that, Kotlin is apparently going into "language on it's own" direction and not necessarily aiming to use JVM (source: https://stackoverflow.com/a/74957737). This slightly alters my argument, still I've seen plenty of tools to migrate Java to Kotlin if you ever needed to port some Java logic. Yes, Flutter recently allows enabling Impeller engine on iOS and Android, previously Skia was used (I am actually not sure if it's not the same engine that KMM uses). To be honest it's not even about Kotlin vs Dart. If you know one language you can pretty easily use another. It's about what libraries, packages you get out of the box in one ecosystem or the other - https://pub.dev/ I think that Flutter ecosystem it's still early, but mature enough for many projects. . Bear in mind that you very often rely on some library which gives you native access to certain platform. These are not quick to build yourself and save you lots of time if you find one. I don't think KMM has many of these libraries, so often you will have to build one yourself in Kotlin and connect it to Swift and Android SDK (in which case you need to know the native language as well) (edited)
👍 1
Avatar
I wonder if Microsoft won't just catch up with their MAUI and they have lots of addons and packages etc... dotnet is pretty solid. I think I prefer the way you can declare your ui in XML and then mode the interactions or something. Not sure yet. Performance probably sucks big time however.
1:51 AM
I jist hate the JVM so much, that and gradle or maven or we... everything Java I dislike.
1:53 AM
Not sure it matters much which stack you pick today as they will all evolve differently so I'd go with the one that feels right to begin with and has the documentation and tools do that I want to do.
Daniel_Recker_95 joined the server. 3/20/2023 2:13 AM
Avatar
Avatar
Logarithm
I wonder if Microsoft won't just catch up with their MAUI and they have lots of addons and packages etc... dotnet is pretty solid. I think I prefer the way you can declare your ui in XML and then mode the interactions or something. Not sure yet. Performance probably sucks big time however.
Never had chance to work with C#, but it seems is pretty robust, mature language and for quite a while no longer locked in to Microsoft. My understanding is that Xamarin or MAUI they work in a similar way as React Native, which is you still call native UI components. (On the contrary Flutter uses the rendering engine)... so I don't think that performance will be that badly affected. Speaking of XML UI, I worked with Android and really didn't enjoy it (perhaps the MAUI one is nicer?), but before I tried Jetpack Compose I've introduced Flutter. The nested / React way of defining components is much clearer to me than XML. I never liked Java, it's verboseness, clunkiness and being memory hungry. With Android development I was forced to try it... and Kotlin made the introduction much nicer. After a while Gradle is no longer an issue, as you know the quirks. There are exciting projects like GraalVM which make resource startup costs of Java negligible. You can then reuse your project language on the back-end with huge choice of Reactive back-end frameworks (so far tried Vert.x and liked it). I was amazed by understanding how portable the Java ecosystem is... also I've fixed my previous comment and be aware that Kotlin (at least in KMM) is taking: "language on it's own" path and stepping away from JVM. One thing I've understood a while ago, perfect is the enemy of good. I better start using some technology and learn from it, the constantly try to find the best language / ecosystem, which may actually not exist. Same applies to Flutter, my biggest concern is that Google will simply kill it (https://killedbygoogle.com/), but before that happen I am sure that either there will be nice alternative and/or I will have time&resources to migrate my project elsewhere. After all it's Flutter that initially saved me a lot of time, so if I need to "pay it back" a little later, that's still fine with me. (edited)
Avatar
Hi @Daniel_Recker_95 , welcome to the channel !
polyenka joined the server. 3/20/2023 2:03 PM
Avatar
Hi @polyenka, welcome to our channel !
pairg joined the server. 3/22/2023 8:55 PM
Avatar
Hi @pairg, welcome here ! (edited)
zer0 joined the server. 3/24/2023 5:23 AM
Avatar
Hi @zer0 , welcome to our small community !
Avatar
Avatar
zer0
Click to see original message
8:03 AM
Interesting software
👍 1
Avatar
... and it will only get even more interesting with our ambitious 2023 Roadmap - https://s3drive.canny.io
8:10 AM
I'm a homelabber so I'd love to host this on my server someday
8:12 AM
If you don't mind me asking, is Sync Solutions a company?
Avatar
Avatar
zer0
I'm a homelabber so I'd love to host this on my server someday
The architecture of the client does require valid S3 endpoint. You can run e.g. MinIO on your end: https://hub.docker.com/r/minio/minio/#! which gives fully S3 compatible API. In such setup it's only S3Drive client on your device hitting your MinIO endpoint which is also in your control.
Avatar
Avatar
Tom
The architecture of the client does require valid S3 endpoint. You can run e.g. MinIO on your end: https://hub.docker.com/r/minio/minio/#! which gives fully S3 compatible API. In such setup it's only S3Drive client on your device hitting your MinIO endpoint which is also in your control.
Is this also true for the webapp when used with local s3 servers? Or is data proxied through another server?
Avatar
Avatar
zer0
If you don't mind me asking, is Sync Solutions a company?
It's a trade name, we're currently registered as a sole proprietorship, we're pending registration and paperwork to switch to limited company. This will likely be finished around Q2/Q3 2023. It is possible the trade name will change at that point. (edited)
Avatar
Cool. Nothing wrong with companies doing FOSS. Just trying to understand the motivations and goals
Avatar
Avatar
zer0
Is this also true for the webapp when used with local s3 servers? Or is data proxied through another server?
Webapp is exactly the same codebase as desktop and mobile clients (thanks to Flutter), so it's hitting the API directly, you can verify that in your browser (right-click + inspect element and see the network tab - XHR requests). There are few exceptions where we might hit some other server (but never for S3 related operations), but we've mentioned that explicitly in our privacy section: https://s3drive.app/privacy
8:22 AM
I see pro features mentioned. Do you see a bitwarden-like business model?
Avatar
Avatar
zer0
Cool. Nothing wrong with companies doing FOSS. Just trying to understand the motivations and goals
Just for you to be aware we're not exactly FOSS. In our setup the clients code is closed, but the back-end protocol (S3) is open, meaning that you can always switch to other S3 client if you're not happy. There are other models on the market. For instance there are multiple companies having their clients open-sourced, but back-end is closed, which has some other advantages, but also disadvantages (vendor lock-in being one of them).
8:25 AM
Yea
8:25 AM
Ok I skimmed the webpage and thought it was FOSS
8:27 AM
So files can be decrypted with or without s3drive am I understanding this correctly?
8:28 AM
Both the encryption and backend are safe from vendor lock-in?
Avatar
Avatar
zer0
I see pro features mentioned. Do you see a bitwarden-like business model?
We've been thinking about sustainable business model for a while. Our plans include hosted S3 accounts, which would include all of the Pro features when you get the data plan. BItwarden business model, we're not there yet, maybe eventually.
Avatar
Avatar
zer0
So files can be decrypted with or without s3drive am I understanding this correctly?
That's right, this is because we're compatible with the AWS FOSS implementation: https://docs.aws.amazon.com/general/latest/gr/aws_sdk_cryptography.html#crypto_features
Avatar
That's great. That makes me feel more confident
Avatar
Avatar
zer0
That's great. That makes me feel more confident
In our roadmap we plan to release open source decryption / export tool: https://s3drive.canny.io/feature-requests/p/open-source-data-decryption-export-tool
Avatar
Very nice. Reminds me of standard notes
Avatar
Avatar
zer0
Both the encryption and backend are safe from vendor lock-in?
Back-end yes, no vendor lock-in, because we plan to stay compatible with S3. There maybe additional extra features on top of S3 protocol which are not possible to achieve with current S3 (related to e.g. file sharing and atomic rename/copy) in which case we might come up with some optional middle-man.
Avatar
So far I see this as a valid replacement to rclone WebDAV serve with rclone's crypt -- for less technical people who are afraid of CLIs
Avatar
Avatar
zer0
Both the encryption and backend are safe from vendor lock-in?
Regarding encryption, there are couple challenges that we face with current AES-256 GCM implementation (mostly related to bigger files and video streams). We have plans to improve that: https://s3drive.canny.io/feature-requests/p/explore-support-for-xchacha20-poly1305 https://s3drive.canny.io/feature-requests/p/support-streaming-of-encrypted-videos but that still needs more research and there are couple dependencies. No matter what, our encryption standard will remain open and if possible compatible with other tooling.
Avatar
Avatar
zer0
So far I see this as a valid replacement to rclone WebDAV serve with rclone's crypt -- for less technical people who are afraid of CLIs
Yes, but hopefully not only this. I find S3Drive way more convenient tool than rclone for accessing my files or backing up my photos on a day to day basis.... and I am not afraid of CLIs. (edited)
Avatar
yes that too of course
8:39 AM
S3 compatible app on android at least, that looks nice is rare
8:39 AM
Even if I don't use encryption, it's still handy to manage a bucket with a GUI
Avatar
Avatar
zer0
S3 compatible app on android at least, that looks nice is rare
Heh, thanks for that. Our design is far from modern expectations, but well, there are other S3 clients which kind of lowered entry bar for us 🙂
Avatar
design is not bad at all
8:40 AM
i kinda like it
8:41 AM
on desktop tho, it feels very weird to use a smartphone/tablet-ish UI
Avatar
Avatar
zer0
on desktop tho, it feels very weird to use a smartphone/tablet-ish UI
You're right, on the plus side, this allowed us to release desktop clients early. GUI will be improved, once we get through other items... and we're fully booked for 2023 so far.
Avatar
also the taskbar icon imho looks too close to windows explorer icon
Avatar
Avatar
zer0
also the taskbar icon imho looks too close to windows explorer icon
That's a valid point, thanks. Being an Ubuntu user myself didn't have that graphic encoded in my mind.
Avatar
@zer0 If you have any other questions, concerns I would be glad to help out... and speaking of FOSS you might actually think of reasons behind our decision and it's mostly related to the fact that we try to build a sustainable business. With our open back-end model, OSS clients would simply kill any ways for us to monetize our work. OSS in general has funding issues and there are many examples of that. Companies in order to sell OSS, try to build closed source back-end, vendor lock-in you into their solution and make self-hosting pretty hard (despite code being open source). It's fine to find ways to monetize their work, it's just it's little bit deceptive practice (to claim Free, Open, but being far from it) in my opinion. As with every business, things may or may not work out. We plan to introduce certain safeguard triggers (e.g. if we ever planned to wind down our operations we would then release our work on some open-source license), more on that in our next updates. (edited)
Avatar
of course
9:00 AM
all the best
9:01 AM
oh something you might want to look into:
9:01 AM
i use this https://garagehq.deuxfleurs.fr/ at home as my s3 server
An open-source distributed storage service you can self-host to fullfill many needs.
👍 1
9:01 AM
s3drive doesn't seem to work with it
9:02 AM
works fine with rclone, arq, cloudberry just fine
9:03 AM
Avatar
Avatar
zer0
Click to see attachment 🖼️
Thanks, we'll look into that.
Avatar
Avatar
zer0
Click to see attachment 🖼️
I know I probably ask for too much, but do you have an example endpoint I could use to try it out? If not, no worries we'll have it running and then play around.
9:06 AM
allow me an hour
👍 1
Avatar
Avatar
zer0
allow me an hour
Great, thanks that would speed things up on our end. Don't feel rushed though. We're here most of the day anyway. (edited)
Avatar
Avatar
zer0
Click to see attachment 🖼️
I did a quick setup on my local: https://garagehq.deuxfleurs.fr/documentation/quick-start/ and discovered that the issue is that by default in enforces region: garage... and there is no way to provide region in S3Drive. It seems that we may add additional form field to specify the region.
Avatar
Avatar
zer0
Click to see attachment 🖼️
The quick fix if you want to use S3Drive is to set the region in toml file like this: s3_region = "us-east-1". We auto-detect region from the endpoint URL and have a way to detect custom region from MinIO.... and if it doesn't work we use the most common default which is us-east-1.
10:16 AM
it is set up as us-east-1 in toml
10:16 AM
sending you my test creds
Avatar
Avatar
zer0
it is set up as us-east-1 in toml
Thanks, got this. In fact there is an issue on our side. The detection logic (pretty stupid regex) incorrectly detects the region from your endpoint. When I've tested Garage locally using just IP addresses it wasn't an issue. I've sent you possible temporary resolution via PM. (edited)
Avatar
Avatar
zer0
I see pro features mentioned. Do you see a bitwarden-like business model?
I think I haven't responded to that properly. We haven't decided exactly, our closest business plans include managed accounts with storage plans instead of selling "Pro" features. We've still left a room for ourselves if we ever decided to sell "Pro" features... and since we wouldn't like to disrupt current early adopters there is the Enrol API mentioned in our Privacy section that I believe you refer to. Realistically speaking, we'll keep certain Pro features always free (E2E encryption, photo backup etc.) to lower the barrier of entry and likely provide some additional Pro extensions and possibly per seat licensing model for companies in the future. We'll certainly stay cautious with changes and we extremely value existing users who contribute by providing valuable feedback. (edited)
✅ 1
👍 1
slipstream joined the server. 3/24/2023 10:30 PM
Avatar
@Tom working nicely with garage now
10:34 PM
👍
Avatar
Avatar
zer0
@Tom working nicely with garage now
Thanks for letting me know. Do you mind if I ask how are you finding Garage and did you try any S3 compatible alternatives that is MinIO / Seaweed FS / Ceph or anything like that?
Avatar
I did use minio before using garage
4:53 PM
I think I'll be moving back to minio
4:55 PM
Garage store a lot of chunk files which are hard to deal with on ext4
4:55 PM
It takes ages to run ncdu on the data folder
Avatar
Avatar
zer0
Garage store a lot of chunk files which are hard to deal with on ext4
Ah yes, I've seen in their documentation that they actually recommend XFS instead due to possible inode limit issues with EXT4.
4:56 PM
I like the CLI tho
Avatar
... and it's a single Go binary with less baggage that MinIO already have.
4:57 PM
I would be curious to try SeaweedFS though. (edited)
Avatar
I was looking into SeaweedFS today
4:58 PM
Looks very interesting
4:58 PM
I need to read the docs a bit more
KiraUsagi joined the server. 3/26/2023 3:24 AM
Avatar
Hi @KiraUsagi, welcome to our channel !
Exp0rt joined the server. 3/28/2023 5:39 AM
Avatar
Hi @Exp0rt, welcome to our small world !
dsdsdsdsdsdsdsds joined the server. 3/30/2023 1:26 AM
Avatar
I'd go with whatever option had the easiest backups tbh. I find that setting up an environment is not that hard, having redundancy too, but having good backups isin't that simple.
AraAra (✿◠‿◠) joined the server. 4/7/2023 6:43 PM
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:43 PM
Sup people
Avatar
Hi @AraAra (✿◠‿◠), welcome to the channel, how are things?
Avatar
Avatar
Tom
Hi @AraAra (✿◠‿◠), welcome to the channel, how are things?
AraAra (✿◠‿◠) 4/7/2023 6:44 PM
Good good. Just recently finished college. Now looking to get into a university in Canada
Avatar
Avatar
AraAra (✿◠‿◠)
Good good. Just recently finished college. Now looking to get into a university in Canada
Exciting times. What degree you aiming for? Let me guess... CS? 🙂 (edited)
Avatar
Avatar
Tom
Exciting times. What degree you aiming for? Let me guess... CS? 🙂 (edited)
AraAra (✿◠‿◠) 4/7/2023 6:45 PM
Aahh not really
6:46 PM
I was considering it
6:46 PM
But given my ADHD. I decided to go towards English literature/writing/media etc.
6:46 PM
As I like to be creative
6:47 PM
I am also however, a tech nerd 🤓
Avatar
Right, so my guess wasn't exactly right. It's just so many people I've talked to are either CS students or converting to IT.
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:48 PM
I really did want to
6:48 PM
But I also didn't want to make myself suffer mentally (edited)
6:48 PM
As I've suffered enough 🤷
Avatar
Yeah sure. We forget in our society that in the long run mental health wins over any aspect. I also know some people who tried hard to convert to IT for the luxurious pay being the reason one, but ultimately decided it's not for them. (edited)
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:50 PM
eg. Due to family pressure, I went with the science department starting from 9th grade to college
6:51 PM
And oh boy, worst mistake of my life
6:51 PM
I was in a mentally dark place. Almost decided to "game over" myself
6:52 PM
I've recovered in the past few months. Life's much better now 💪
Avatar
Yep I know that, it's like if someone else decides what you like doing... and noone asks you. Happened a lot around my circles. Sorry to hear that, but I am glad that you've took some steps and recovered. Good luck with your submission in Canada, stay strong ! (edited)
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:53 PM
Thanks 👍🏻
6:53 PM
Feel like this server isn't promoted enough
6:53 PM
Really good app btw
Avatar
Thanks, it's all pretty new and still expanding. We're not doing much of a marketing, little bit overwhelmed by outstanding tech items right now. (edited)
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:55 PM
That's alright
Avatar
Is there anything in particular I can assist you with?
Avatar
AraAra (✿◠‿◠) 4/7/2023 6:55 PM
I've personally done some android development myself
6:56 PM
It can be quite interesting
Avatar
Indeed, we've started with Android and decided to expand on all platforms.
Avatar
Avatar
Tom
Is there anything in particular I can assist you with?
AraAra (✿◠‿◠) 4/7/2023 6:57 PM
Oh yeah forgot, I can't seem to be able to delete folders
6:58 PM
It loads for a few moments but the folder persists
Avatar
Avatar
AraAra (✿◠‿◠)
Oh yeah forgot, I can't seem to be able to delete folders
I see, what cloud are you using? We've seen such behaviour with MinIO and iDrive.
Avatar
Avatar
Tom
I see, what cloud are you using? We've seen such behaviour with MinIO and iDrive.
AraAra (✿◠‿◠) 4/7/2023 6:59 PM
Storj
Avatar
Avatar
AraAra (✿◠‿◠)
Oh yeah forgot, I can't seem to be able to delete folders
Also, there are lots of improvements that we will be releasing regarding folder operations: https://discord.com/channels/1069654792902815845/1069654792902815848/1085780599962349648 "Deleting item is a different beast. Currently we're not deleting items, but rather "copy" them to trash one by one, and then delete files in the original location. It's not that delete is slow, but the "copy" operation takes time and it's safe to assume that "thousand" files operation will be roughly 1000x slower then a single file. What can help here is to switch to S3 provider/region that has closest proximity to your internet connection, but no matter what results won't be satisfying enough. No worries though, we plan to address this in ~April 2023 by adding support for native S3 versioning: https://s3drive.canny.io/feature-requests/p/version-preview-restore-integration-with-trash so we can actually skip Copy operation... and Delete itself is fast enough. " (edited)
Avatar
Avatar
AraAra (✿◠‿◠)
Storj
Thanks for your report. At this stage all I can say is sorry that it doesn't work as expected, we will have a closer look regarding Folder delete and Storj. It's usually some tricky caching behaviour that we've hasn't managed consistently reproduce... but I am sure that we'll eventually get to this. Ultimately we can come up with some compromise, e.g. hide folder for some time after delete. (edited)
Avatar
Avatar
AraAra (✿◠‿◠)
Storj
One question that I have, does it stay like this forever or eventually the folder entry disappears?
Avatar
Avatar
Tom
Thanks for your report. At this stage all I can say is sorry that it doesn't work as expected, we will have a closer look regarding Folder delete and Storj. It's usually some tricky caching behaviour that we've hasn't managed consistently reproduce... but I am sure that we'll eventually get to this. Ultimately we can come up with some compromise, e.g. hide folder for some time after delete. (edited)
AraAra (✿◠‿◠) 4/7/2023 7:10 PM
Ah no need to be sorry
👍 1
Avatar
Avatar
Tom
One question that I have, does it stay like this forever or eventually the folder entry disappears?
AraAra (✿◠‿◠) 4/7/2023 7:10 PM
Seems to stay like that
Avatar
Avatar
AraAra (✿◠‿◠)
Ah no need to be sorry
@AraAra (✿◠‿◠) I will let you know once I find out something with Storj, in the meantime was wondering how are you finding other aspects of S3Drive? Is there anything that you don't like / like in particular? It's an early stage and every single feedback is extremely valuable for us. (edited)
Avatar
Avatar
Tom
@AraAra (✿◠‿◠) I will let you know once I find out something with Storj, in the meantime was wondering how are you finding other aspects of S3Drive? Is there anything that you don't like / like in particular? It's an early stage and every single feedback is extremely valuable for us. (edited)
AraAra (✿◠‿◠) 4/7/2023 7:51 PM
Ability to turn off Trash/Recycle bin would be pretty nice
👍 1
7:52 PM
As for the Ui, I would like to see Monet theming.
prematrix joined the server. 4/8/2023 12:37 AM
Avatar
Hello
12:37 AM
12:38 AM
Why can't I connect to my iDrive E2?
Avatar
Hi @prematrix, this happens when iDrive E2 encryption is enabled. In general they use non-standard approach to reporting object hashes that we rely on. There are some ways around, but we haven't got to that yet. More on that here: https://discord.com/channels/1069654792902815845/1069654792902815848/1081247124580204574 and: https://s3drive.canny.io/feature-requests/p/workaround-idrive-e2-auth-issue-if-default-encryption-is-used The recommended path for iDrive E2 is to disable their encryption and enable in-app E2E encryption. (edited)
Avatar
Thank you for the response. I will use cryptomator, until the issue is fixed.
Avatar
Avatar
prematrix
Thank you for the response. I will use cryptomator, until the issue is fixed.
Thanks for letting us know. We will definitely have it sorted pretty soon. Stay tuned !
Xenthys joined the server. 4/10/2023 10:14 PM
Avatar
Hello there! ablobwave The Discord server is hard to join from the app since it opens a webview, I'd recommend opening the invite externally so the Discord application can pick it up, or at least the standard web browser. Trying out the application with MinIO, so far so good, pleased by the rename function that likely performs a copy + delete under the hood. It does what one would expect from an S3 client, no ads either, really liking it. (edited)
Avatar
Not sure what the .aa* file and folder are about, but some "don't touch my bucket" parameter would be nice if the app doesn't strictly need them, otherwise that sounds like an additional bucket policy :D EDIT: looks like the file is for some kind of init feature within the app, and one of the two folders is the trash. I've seen the versioning feature request, but the trash folder could be opt-in if possible. (edited)
Avatar
Hi @Xenthys, welcome to our channel. Thanks for your post. Being relatively new Discord user myself such feedback is extremely useful, thanks ! You're right, "rename" performs a "copy" and then "delete" (but only if "copy" was successful operation.). The .aainit file is our write test, as well as ETag response validation (which is required for not yet released syncing features), as some providers (talking mostly about iDrive E2 with SSE enabled) don't generate valid ETags. BTW. Would you like S3Drive to support read-only mode? Regardless, we will try to improve clarity of this operation, so user feels more confident that we're not doing some shady write/reads. Speaking of Trash itself, likely this week starting on Android first there will be a Settings option to disable Trash feature altogether (which is a soft-delete emulation, but slow and pointless if bucket already supports versioning). Versioning UI with restore options will come little bit later. (edited)
Avatar
Avatar
Tom
Hi @Xenthys, welcome to our channel. Thanks for your post. Being relatively new Discord user myself such feedback is extremely useful, thanks ! You're right, "rename" performs a "copy" and then "delete" (but only if "copy" was successful operation.). The .aainit file is our write test, as well as ETag response validation (which is required for not yet released syncing features), as some providers (talking mostly about iDrive E2 with SSE enabled) don't generate valid ETags. BTW. Would you like S3Drive to support read-only mode? Regardless, we will try to improve clarity of this operation, so user feels more confident that we're not doing some shady write/reads. Speaking of Trash itself, likely this week starting on Android first there will be a Settings option to disable Trash feature altogether (which is a soft-delete emulation, but slow and pointless if bucket already supports versioning). Versioning UI with restore options will come little bit later. (edited)
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Avatar
Avatar
Xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Thanks for your help. Currently sharing uses S3 presigned URL, they're part of the protocol, however the signature validity is limited to 7 days max. The HTML is in fact created when sharing files externally to create the "album" feel. The workflow is that we create "presigned" URL for every resource that you share, then we embed them in the HTML which is itself "presigned". There will be in-app sharing later this year, which will basically open shared resources within the Web app: https://s3drive.canny.io/feature-requests/p/in-app-sharing It will still have to follow the S3 protocol limitations though. We're exploring different ways, so we can generate permanent links and allow users revoking them. There are multiple ways, one way is to create a middle-man (link shortener/alias and presigned links generator) to constantly extend the validity and keep the same URL scheme. The other way is to aim more into closer integration, e.g. with permission management and STS using MinIO we could revoke shared resources, something which isn't possible with pure S3 protocol. We haven't exactly agreed on the best way forwards. Thanks for all your feedback and I am more than happy to hear how are you finding different parts of the app and whether it suits your workflow. Speaking of MinIO, last time when we've tried to test the S3Drive with MinIO we've came across same listing caching issues when folder was deleted with all of its contents. The contents was removed properly, but the folder entry stayed in the s3 ls even though headObject couldn't retrieve it as a valid S3 entry. I am curious if you came across of something similar. (edited)
Avatar
Yes, 7 days is the maximum but not the minimum, when I share a file however I'd like to keep using raw presigned URLs without having app-specific features included without me being aware. I'm looking for an S3 browser to use S3 features, if I wanted a fully-featured platform I'd install Nextcloud instead and use S3 as the backend storage, be careful about feature creep! I expect the majority of users who are technical enough to have an S3 bucket to use the app just for a quick file access or upload as well. I haven't encountered any issue with MinIO yet, but I deleted content through the console with their versions when I figured out the trash feature. I know MinIO doesn't immediately update the file list after a create or delete operation, even the console shows an invalid object count if you check too soon after, so maybe that's related?
Avatar
While my messages are very opinionated, in the end it remains your application of course, I would never order an independent developer to do what I want, unless we have a paid contract haha
Avatar
Avatar
Xenthys
Yes, 7 days is the maximum but not the minimum, when I share a file however I'd like to keep using raw presigned URLs without having app-specific features included without me being aware. I'm looking for an S3 browser to use S3 features, if I wanted a fully-featured platform I'd install Nextcloud instead and use S3 as the backend storage, be careful about feature creep! I expect the majority of users who are technical enough to have an S3 bucket to use the app just for a quick file access or upload as well. I haven't encountered any issue with MinIO yet, but I deleted content through the console with their versions when I figured out the trash feature. I know MinIO doesn't immediately update the file list after a create or delete operation, even the console shows an invalid object count if you check too soon after, so maybe that's related?
We will implement slider to allow providing the minimums. Our aim is to actually hide the S3 complexities and provide the "drive" experience for the general public. Our userbase is mixed. I take your point and will make a note to incorporate raw sharing. Speaking of Nextcloud, yes it's an option, but not anyone wants to set up their server, manage it, take care of updates and security... also if you want Nextcloud to not cost a lost (when e.g. hosted on some VPS)... then actually you need to connect it with some S3 provider to get reasonably priced storage. Our aim is to skip layers like Nextcloud and simply using some client-side magic provide similar experience (and less convoluted than Nextcloud - but that's my opinion) using raw S3. Speaking of caching issues. It's likely what we've experienced with MinIO and was little bit confused, because all other providers (except iDrive) update their listings immediately.
Avatar
Avatar
Xenthys
While my messages are very opinionated, in the end it remains your application of course, I would never order an independent developer to do what I want, unless we have a paid contract haha
If we only got more such "opinionated" messages, it would've been much easier to build stuff... and working full-time on this for about a year now without a single paycheck, I wouldn't mind a paid contract 🙂 ... but seriously, it's actually one of the coolest things I've been working on in my 10+ years career and seeing already such positive reception we've no intentions to stop. (edited)
Avatar
I see, however you're going to have a hard time implementing a nice drive experience on top of bare S3 buckets, especially if you reduce yourself to the common denominator between the various providers. I guess some kind of "expert mode" would help settle the debate, where you expose raw S3 functions and let the user do whatever without interfering. Yes, Nextcloud was an example, I don't know many people with an S3 bucket who don't already have a way to share files, and most will probably just use OneDrive or similar if they want simplicity. With the single-file installer and compatibility with any shared hosting service, it's not the hardest to use 😄
10:51 AM
I'd love to be rich enough to offer paid contracts by myself, the company I work at would unfortunately not be interested, our buckets are going to be heavily locked down so even accessing them directly from a company laptop on the internal network would be frowned upon. Welcome to healthcare!
Avatar
Avatar
Xenthys
I'd love to be rich enough to offer paid contracts by myself, the company I work at would unfortunately not be interested, our buckets are going to be heavily locked down so even accessing them directly from a company laptop on the internal network would be frowned upon. Welcome to healthcare!
We're also planning some enterprise offerings. Basically S3Drive, locked down within the internal infrastructure with SSO, permission management, audit log and some management tools on top of MinIO (or other solution). Obviously the model would've to be slightly different. We would likely provide management tools as an open-source on some license. I am just thinking loud and this is something we will start work on 2023 Q4 / 2024 Q1 at earliest. Out of curiosity what your company uses for the S3? Is it MinIO, Ceph or some cloud S3? (edited)
Avatar
We're moving from Azure Blob storage to AWS S3 directly, so pretty much going from the least to the most compliant S3 implementation :p (edited)
11:00 AM
As for our SSO, it's based on Microsoft so probably not what you would expect for a company fully using AWS as its sole cloud provider.
11:01 AM
I have to say, my main use of S3Drive is to have an S3 app on my phone, the others weren't as appealing, but your vision fully makes sense once we take all platforms into account.
11:08 AM
Regarding licensing, maybe you'd like the Sustainable Use created by n8n: https://github.com/n8n-io/n8n/blob/master/LICENSE.md It's based on the Fair-code software model (https://faircode.io/) which only restricts commercial applications of your software, it's interesting.
👍 1
Avatar
Avatar
Xenthys
I see, however you're going to have a hard time implementing a nice drive experience on top of bare S3 buckets, especially if you reduce yourself to the common denominator between the various providers. I guess some kind of "expert mode" would help settle the debate, where you expose raw S3 functions and let the user do whatever without interfering. Yes, Nextcloud was an example, I don't know many people with an S3 bucket who don't already have a way to share files, and most will probably just use OneDrive or similar if they want simplicity. With the single-file installer and compatibility with any shared hosting service, it's not the hardest to use 😄
It's indeed a challenge to provide a nice drive experience on top of bare S3. There are multiple missing features, block read/writes, bulk operations, atomic operations. We're not discouraged though, as there are ways around. The beauty of such approach is that we're staying compliant with S3 at all times, so there is no vendor lock-in or proprietary back-end. With some optional tooling/layers we can improve the experience. The other advantages of S3Drive comparing to well-established players is price competitiveness (S3 is just cheap)... and ZK client-side encryption, so you can drop your files anywhere and secure them, so they are private. To be honest... every week/month as we build it we find new ideas that slightly affect our direction and it's just how things are developed.
Avatar
Hey, I play Star Citizen, unless your app stays in alpha for a decade you're good doggokek
Avatar
Avatar
Xenthys
Regarding licensing, maybe you'd like the Sustainable Use created by n8n: https://github.com/n8n-io/n8n/blob/master/LICENSE.md It's based on the Fair-code software model (https://faircode.io/) which only restricts commercial applications of your software, it's interesting.
Cool, thanks. It's really helpful. We've been studying different open-source licensing and having chance to read lots of horror stories (ElasticSearch, core-js recently ... and couple more) we were not exactly convinced what's the best path to take given that the S3 protocol itself is open and the fact that we don't have the proprietary back-end as a means to protect the IP by making the open-source client useless without back-end (not that we would want to take that route). (edited)
Avatar
Well, the horror story for most users is seeing a project moving to another license, no matter from which to which. The model used by n8n has been criticized by pro-FOSS folks, but GitHub stars don't pay rent.
11:15 AM
I find it very interesting because self-hosted people won't have any barrier, even within companies, but they can't offer a SaaS version of your product. That seems to match your vision.
11:17 AM
Your "back-end" would be the layer you plan to use in order to transform an S3 bucket into a drive I assume, but licensing should only be validated with a lawyer anyway.
Avatar
Avatar
Xenthys
Your "back-end" would be the layer you plan to use in order to transform an S3 bucket into a drive I assume, but licensing should only be validated with a lawyer anyway.
It's all interesting, thank you. I can imagine FOSS communities not approving such licences, but pragmatic open-source is just unsustainable and we're probably yet to see even more similar licences and more projects using these. (edited)
Avatar
Avatar
Xenthys
I find it very interesting because self-hosted people won't have any barrier, even within companies, but they can't offer a SaaS version of your product. That seems to match your vision.
We'll get back to the licensing later this year. Next couple months are about delivering the major roadmap items. By that time we might have a clearer picture and more established userbase.
Avatar
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
Avatar
Avatar
Xenthys
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
If bare-bones S3 means, simply disable some convenience features then why not. Rename with old name object version delete is possible. Normally I would be hesitant to implement it, since it's easy to for feature creep to kick in... and it's not sort of feature where one would like to make a mistake in. On the other hand we already have to the delete (after copy) to emulate move. I like the idea to not clutter the bucket. We will have it implemented. (edited)
Avatar
Managing versions is going to be annoying when you take compliance mode into account, S3 is a feature creep in itself already haha
Avatar
Avatar
Xenthys
Managing versions is going to be annoying when you take compliance mode into account, S3 is a feature creep in itself already haha
Yes, but what's the alternative? 🙂 I love that one: https://xkcd.com/927/
Avatar
Indeed, I'm just joking about the fact S3 itself is no longer true to its name when you take every feature into account.
12:12 PM
But even with compliance, worst case scenario is handling a 403 technically speaking, just ensure the error message is clear enough :p
12:13 PM
If I hated the S3 standard, I wouldn't be here 🙃
Avatar
Basically growing pile of IFs, growing pile of tests... and possible becoming little bit less exciting to work on... but if it's what it takes to stay compatible... well we can still handle it. Well, S3 is far from perfect... what I love about it... it is actually a standard that's broadly accepted. (edited)
12:15 PM
Finally, Compliance mode is a feature with real use-cases, so it's not like this work gets more pleasant with a different standard. One needs to handle 403 regardless of the API. (edited)
Avatar
Avatar
Tom
Yes, but what's the alternative? 🙂 I love that one: https://xkcd.com/927/
I liked IRC as a chat platform standard, even though authentication and privacy is a mess. This normally makes you think about another XKCD…
12:17 PM
Indeed, and versioning / object locking / compliance are all part of the same mechanism so you can hardly implement one without the others.
Avatar
Avatar
prematrix
Thank you for the response. I will use cryptomator, until the issue is fixed.
Hi @prematrix , it's been addressed in a 1.1.4 Android release which is now live. It will be available on different platforms later this week.
Avatar
Avatar
Xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Disabling Trash in Settings menu is now a thing on Android, since 1.1.4 release.
Avatar
Avatar
stca
For b) I have an Samsung S22 Ultra.
Hi @stca, Since 1.1.4 release on Android, the encrypted iDrive E2 buckets are now supported.
Avatar
Avatar
Xenthys
I liked IRC as a chat platform standard, even though authentication and privacy is a mess. This normally makes you think about another XKCD…
Yes, I remember IRC, but I am relatively young and got the internet connection pretty late, by the time I was connected and when lived in Poland, Gadu-Gadu took over the whole country. IRC always reminds me the old Linux days, where you had to compile everything. I believe that many IRC users might be in their mid-50s now 🙂 (edited)
Avatar
Well done, downloaded the update and found the option, thanks!
👍 1
2:36 PM
There's an unexpectedly high number of younger people on IRC, by curiosity or because some FOSS projects refuse non-FOSS chat platforms, and IRC remains easy to join with web clients.
2:39 PM
Now waiting on the .aainit file being nuked (delete file itself + all its versions) once the init is done and raw presigned URL sharing doggokek
Avatar
Avatar
Xenthys
There's an unexpectedly high number of younger people on IRC, by curiosity or because some FOSS projects refuse non-FOSS chat platforms, and IRC remains easy to join with web clients.
Sure, but at the same time there are newer and more exciting protocols. https://matrix.org/ being one of them.
Avatar
It's heavier to run and there isn't as much compatibility yet, moderation remains an issue as well. But I agree, we'll eventually get there, in the meantime Discord is fine!
Avatar
Avatar
Xenthys
Hello there! ablobwave The Discord server is hard to join from the app since it opens a webview, I'd recommend opening the invite externally so the Discord application can pick it up, or at least the standard web browser. Trying out the application with MinIO, so far so good, pleased by the rename function that likely performs a copy + delete under the hood. It does what one would expect from an S3 client, no ads either, really liking it. (edited)
... forgot to mention that we've also fixed the Discord link with 1.1.4 release. Thank you for reporting this issue.
Avatar
Oh nice, I checked and it indeed gets caught by the Discord app, well done and thanks to you for the quick fix!
Avatar
Avatar
Xenthys
The more I think about it… I can't hire you, but would an "expert mode" bounty work? Basically a "gimme bare-bones S3 and don't touch my bucket!!" mode as described above. Another interesting feature would be to be able to set the filename on upload, because rename leaves deleted versions. Or maybe a checkbox to delete the renamed version on versioned buckets? I assume you're going to have a versioning check for the trash feature later, so the idea would be to piggyback on it if it's not too much work. Let me know if there's anything I can do to help of course.
I've had a thought about the bare bones presigned URLs. The current "album sharing" allows sharing more than one file/media, as well as allows sharing client-side encrypted content, since HTML includes JS decryption code and there is key injected in the URI (after #). This isn't possible with raw presigned URL. Having said that, we could either default to raw presigned URL if it's a single and unencrypted file share (or provide some configuration option to determine the single unencrypted sharing file mode). The only issue that I have with this approach is, that now we're ending up maintaining two solutions, but if it's what it takes to make the community happy, we'll handle it. (edited)
Avatar
I don't represent the community as a whole, but I find sharing a single file from a classic S3 bucket is quite common and what I personally expect to be able to handle from any S3 client. 😅
8:53 PM
It could be a toggle up to the user, as a "use at your own risk" kind of deal. You already handle presigned URLs, so I assume you'd just return it to the user instead of continuing the whole "setup an album" procedure.
Avatar
Given the size of S3Drive community you're significant part of this at this stage 🙂 Fair enough, we'll plan this in our items along with the slider which needs to be done anyway.
blobooh 1
Avatar
Avatar
Xenthys
It could be a toggle up to the user, as a "use at your own risk" kind of deal. You already handle presigned URLs, so I assume you'd just return it to the user instead of continuing the whole "setup an album" procedure.
Indeed. Just realised that we actually can't base this purely on fact whether file is encrypted or not, because from a client point of view we don't know that before we headObject and get the envelope AES keys.... so it must be a toggle with some warning. It would then simply return the Blob that's stored on S3, regardless of what's inside. (edited)
Avatar
I was thinking about an "advanced features" toggle that wouldn't change the "Share" button's behavior, but add a "Create pre-signed URL" button under it maybe?
Avatar
Avatar
Xenthys
I was thinking about an "advanced features" toggle that wouldn't change the "Share" button's behavior, but add a "Create pre-signed URL" button under it maybe?
That's good idea as well. In that case we don't interfere with existing workflow and UI, we simply suplement new advanced feature. I think I like it more.
9:02 PM
Cool, sounds like we've a plan.
Arcanex joined the server. 4/12/2023 4:49 AM
Avatar
Hey there! Joined since I had a question or two. Does S3Drive support backing and "syncing" up an external drive? Looking for more a set and forget option, but wasn't too sure.
Avatar
@Arcanex Hi ! Not out of the box. The sync modes are closer than ever: https://s3drive.canny.io/feature-requests/p/syncbackup-options-two-way-one-way and there will be nothing stopping you to sync the whole drive letter to the remote location. Having said that it won't be really the best tool to reliably back up your external drive for quite a while and there are some unique challenges (e.g. what if drive letter changes when you reconnect drive, how shall we handle it?) that we haven't even tried solving just yet. You might be better off using tools e.g. Rclone and some custom scripting. (edited)
👍 1
_therealrooster_ joined the server. 4/12/2023 8:27 PM
Avatar
_therealrooster_ 4/12/2023 8:28 PM
hi! trying to setup the app, but i gett the CORS error. is there a guide for this?
Avatar
Avatar
myfrogger
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
Hi @myfrogger I hope you're doing well. This is to let you know that long awaited option to list all available buckets that you've suggested will be available today/tomorrow (awaiting release) on Android and will be deployed to other platforms later this week:
8:29 PM
@_therealrooster_ Hi and welcome to the channel, what platform are you using? Is it Web? (edited)
Avatar
_therealrooster_ 4/12/2023 8:29 PM
i was using web to try to set it up before i tried to hard on the android app.
8:32 PM
i dont need to use the web app. just android. i guess try that setup with android?
Avatar
@_therealrooster_ Basically CORS needs to be enabled for bucket which can be done by any non-web client using: "Set up CORS" option which shall return clear message that it succeeded. In principle web client shall be able to some extent detect CORS issue and "Set up CORS" via proxy, but that's pretty experimental and may not work for all browsers consistently. Does your bucket support CORS setting? What S3 provider are you using? Yes if Web didn't work, please try an Android (or other client) first and use: "Set up CORS" to see what happens. (edited)
Avatar
Avatar
_therealrooster_
i was using web to try to set it up before i tried to hard on the android app.
Regardless if you manage to get it running. We would extremely appreciate if you could give us some details about your browser, S3 provider and the exact error or screenshot, so we can reproduce it on our side and address this issue. Thanks ! (edited)
Avatar
_therealrooster_ 4/12/2023 8:41 PM
i didnt get it working yet. i will try later. it was supposed to be a short distraction from my AWS training to work on IAM, S3, etc. i'll check it out tomorrow some more.
8:42 PM
i am using AWS, Chrome (latest), S22Ultra, with A13.
8:43 PM
but i will get you more info later. im an SRE. i'll help out as i can
Avatar
@_therealrooster_ Good luck on your AWS training ! One thing that came to my mind. Your user / IAM needs to have permission to modify bucket settings in order to set up CORS correctly, but the error message (if there is any) on Android shall reflect that. Thanks for the details. If you have any other issue I am glad to help. (edited)
Avatar
_therealrooster_ 4/12/2023 8:44 PM
guess imma learn about CORS. thanks for the tips and ill get back to you
Avatar
Avatar
Xenthys
Thank you for your reply! Let me know if you have any question about Discord, I love to help around. For the .aainit file it's fine, but I'd prefer if the app saved the test results locally then deleted the file. I want to be able to write files so I wouldn't use a read-only mode, and we can always create read-only access keys if we want to be sure that's how the app will behave! I'm very interested by the share link expiry slider or date picker though, I never share for 7 days, it's either a smaller duration or permanent. Cool, I don't mind not having the versioning UI yet, but had to delete my file versions + the trash versions to cleanup my bucket so… yeah, trash is cool but I assume most people who want that have versioning enabled. I assume you already have quite a few buckets on various providers to test your features, but I can provide a MinIO one if it could be of interest. There was a 2nd folder with an HTML page in it, not sure what it was about but same thing I'd say, that's probably the least expected action from an S3 browser… While I audited the actions and indeed didn't find anything malicious, that could get me assassinated by my colleagues if I ever connected a more important bucket to the app. doggokek
Hi @Xenthys, I can proudly say that we've released version 1.1.5 on Android which includes some of these changes. When verifying bucket we just try to read the usually non-existent key (.s3drive_bucket_read_test) and verify the response instead of trying to write a file. Slider now works, so it's possible to set expiry time shorter than maximum of 7 days. There is an option to use raw preshared URLs. We've also introduced basic Version UI. It is now possible to preview the revisions. In a next update we will allow opening, preview, deleting and restoring to particular version. Thank you for these suggestions, they were great and helped us to validate it all ! 👍 ... and as always we're open for a feedback.
Avatar
Avatar
AraAra (✿◠‿◠)
Ability to turn off Trash/Recycle bin would be pretty nice
Hi @AraAra (✿◠‿◠), Thanks for this idea. It is now added as a Settings option. It modifies the way the items are deleted to either delete them directly in-place (new hard-deleted behaviour) or move to Trash (previous behaviour).
Avatar
Avatar
myfrogger
As an aside, it would be very helpful if there was a button to click to "list buckets" for me to select. Is my bucket formatted properly? This doesn't seem to be the issue though because even if I enter the wrong credentials, I still can't seem to connect to the server.
This option is now live on Android. Thanks !
Avatar
Avatar
Tom
Hi @AraAra (✿◠‿◠), Thanks for this idea. It is now added as a Settings option. It modifies the way the items are deleted to either delete them directly in-place (new hard-deleted behaviour) or move to Trash (previous behaviour).
AraAra (✿◠‿◠) 4/13/2023 5:05 AM
Thank you for adding that feature!
Avatar
Avatar
AraAra (✿◠‿◠)
Thank you for adding that feature!
There will be couple more things coming in as suggested by our other user here. For instance when moving an item we do "copy+delete" to emulate "move". The thing is that with versioned buckets even though the old file was "deleted" it still uses up space as a revision (delete marker). There will be a setting to let user decide whether they want to cleanup or persist version. (edited)
jdave joined the server. 4/19/2023 9:13 PM
Avatar
Hi, I am starting to use s3drive with Wasabi an S3 solution. Wasabi bucket is configured as immutable with versioning. Testing the delete option in S3Drive, the file disappears in S3drive when 'deleted' but of'course is not deleted in Wasabi.. but it does not come back in S3Drive.. is there a way to fix that?
Avatar
Avatar
jdave
Click to see original message
Avatar
I believe object locking isn't (properly?) supported yet, so it's probably adding a delete marker thus hidden by S3Drive but not "physically" deleted
👍 1
10:33 PM
that would require proper version support, which is in progress as far as I know
Avatar
Hi @jdave, Thanks for your feedback. If the Delete settings are set as on the attached screenshot, we delete file directly from S3, however we still don't delete the object's versions that were created when file was initially created. In theory we could implement an option to also delete a version during a file delete, but if we were to do it immediately it would slow down the delete operation significantly since there is no way to delete multiple versions in one request. Our immediate plan to address this was to provide list of deleted (yet still versioned) files in the current Trash (which is somewhat legacy option where files landed for users which didn't want to delete file in-place, but didn't have a bucket which supported versioning). What would be your preferred way how S3Drive works? Would allowing deleting versions from the Trash be sufficient for you (at least initially?) In theory we could add a setting where after file is deleted we could mark specific versions to be deleted as well and we could do it asynchronously over the next seconds, but that's little bit more complicated option. In the meantime if this is a showstopper for you, you could perhaps introduce lifecycle policies (which Wasabi supports as well). You could set up to delete "all file versions" after x days since file was deleted initially: https://docs.wasabi.com/docs/lifecycle https://wasabi-support.zendesk.com/hc/en-us/articles/360061322811-How-do-I-configure-Object-Lifecycle-Policies-with-Wasabi-#:~:text=Lifecycle%20Policies%20are%20used%20on%20Wasabi%20to%20manage,Lifecycle%20Policy%2C%20please%20see%20our%20documentation%20available%20here. Please let me know how does that sound and if you need my help on setting this up. Thanks ! BTW. Thanks @Xenthys for your help as well ! (edited)
Avatar
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
We've shifted our focus temporarily for the next day or two to finalize Stage II of versioning capabilities, we're going to play with the Object Lock policies and understand them better and see what we can reliably achieve with S3Drive and potentially release them in a next release in a few days. We'll then extract the remaining improvements for the Stage III which we shall address later this quarter. I might get back to you later today (GMT+2 timezone here) as I'll likely have some questions regarding these policies. I would've thought that they'll already prevent running the DELETE command on the object. (edited)
Avatar
Thank you
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Right, so we checked how it works. Wasabi S3 bucket behaves differently depending if versioning is enabled. If versioning is enabled, then regardless of Compliance / Object Lock settings, it is possible to delete an object. Deleting an object created so called: "Delete marker". It is possible to preview all historical versions and restore to any of them, however it is not possible to delete any version from the system until Retention Time has passed. If versioning is disabled, then deleting an object is not possible, because without versioning enabled it would have to delete the object permanently. In a next release which we shall be able to deploy early next week there will be options to Delete/Restore versions and to preview deleted file versions in Trash. There will be also improvements in terms of error handling, e.g. deleting a version restricted by Compliance Settings is not possible, so it shall render clear 403 / Access Denied error. If things go well, we shall be able to also build a generic: "Versions" view which would show technically all recently changed files in the bucket and would allow to delete specific revision(s). There is also an issue with error reporting in S3Drive when versioning is disabled and Compliance Settings enabled. During delete, file seemingly gets deleted, and disappears from the screen, but when screen gets refreshed the entry persist, this is because currently we're using quiet delete, which ignores delete error from Wasabi. We'll have it fixed. Please find couple screenshots which shows the error reporting (it doesn't exactly work like that in a current S3Drive version, but'll be fixed next week) when trying to delete a version restricted by Compliance Settings. I've created a file, then overwritten it with version 2, then deleted it and then uploaded version 3 (so I can have it displayed again and click on the "Show versions" feature). I've then tried to delete one of the revisions which failed as expected.
Avatar
So I was right about delete markers, woooh doggokek
Avatar
Avatar
Xenthys
So I was right about delete markers, woooh doggokek
Indeed, thank you guys for supporting this project with valuable feedback !
Avatar
Avatar
Xenthys
So I was right about delete markers, woooh doggokek
I knew that we will have to get to this eventually 🙂 ... and we're already finding some versioning implementation differences between providers. E.g. MinIO version restore works differently than Backblaze/Wasabi. There are couple bugs (or features?) when deleting entries that we've found on Backblaze... we'll have to deal somehow with all that... but that's fine 🔥 (edited)
Avatar
Ah, as expected indeed, I'm glad S3Drive exists but I'm also glad it's being developed by someone else haha
devOps joined the server. 4/22/2023 4:36 AM
Avatar
Avatar
jdave
Thank you Tom.. i appreciate the full response.. in my case i want to keep Wasabi immutable and not delete anything even if the user tries, i would love to see that S3Drive recognize that the 'delete' was not successful and continue to show that the file exists, as right now the file is missing from S3drive but does exist in Wasabi. I have flushed the cache and rebuilt the search data, but the files still does not show up in S3drive.
Hi @everyone , we've just released a major release (v1.2.0) 🚀 which extends versioning features, modifies behaviour of copy/rename/move/trash function to seamlessly support versioning and don't duplicate version, also there is an option to restore specific versions or delete object versions to save some space. There is also improved error handling, so in case of an Object Lock there will be an error message and relevant Log which can be viewed by long-tapping the app version number. Versioning capabilities are configurable in the Settings. There is a space usage indicator in the left panel / drawer. There is a new Recent section, which displays all recently modified files. Search function is improved, so the index is built faster and also includes implicit folder search (e.g. if there is a file: folder/file.txt, but folder/ entry doesn't explicitly exists, it is still searchable) There is an option to hide files starting with: . As usual there are couple other performance improvements and bugfixes. We would love to hear how are you finding new changes and if version management during file operations is what you would expect. (edited)
7:28 PM
7:29 PM
Good stuff
👍 1
Avatar
Awesome, will try a bit later but that's really nice on paper!
Avatar
The pricing seems really fair
Avatar
Avatar
zer0
The pricing seems really fair
Thanks for the feedback. We try to make it affordable for personal use and if for any reason user is not able to afford Pro, then there is a Basic package which shall be enough for many cases. It's not entirely straightforward for us to come up with fair pricing, as there are some discrepancies between our real expenditures and our motives behind the project. For instance work related to E2E and complexity of Zero Knowledge is about half of the total project R&D, yet we offer E2E for free as we believe that anyone shall be able to receive little bit of privacy regardless if they can afford it or not.
Avatar
I believe encryption itself being free but filename being under Pro is a good balance
11:04 AM
Also the fallback perpetual licensing thing is very interesting
Avatar
If I was in your position, I would only bill for features that have a recurrent cost while factoring global R&D costs into the final price.
Avatar
Is there a timeline as to when the pricing will jump to €14.99? I'd love to purchase but don't exactly need it right now
Avatar
Regarding filename encryption, I don't know which cost it would have on your end so I'm quite neutral about it being a pro feature. On one hand, if it has no impact it's a bit disappointing not to have it as part of E2E in general. On the other hand, it doesn't change much as long as contents are encrypted and you need to monetize, so you have to find features that push people to the pro version.
Avatar
Reminds me of boxcryptor
Avatar
Avatar
zer0
Is there a timeline as to when the pricing will jump to €14.99? I'd love to purchase but don't exactly need it right now
There is no timeline as such, likely won't be changed for the next few months whilst we build all of the remaining features. We're still deciding about our final price, but it won't be far off from what it is now.
👍 1
Avatar
Filename encryption is the one feature that makes me want to pay for it. So from a business POV it's working
Avatar
I want to keep versioning, I believe I'll keep it based on the plans page since i'm using it right now, but morally speaking why not support Tom? 😄
11:12 AM
If it's supposed to be a pro feature I don't mind paying for it, as simple as that. Giving a discount to early adopter is fine, but I wouldn't straight out retain used pro features.
Avatar
Avatar
Xenthys
Regarding filename encryption, I don't know which cost it would have on your end so I'm quite neutral about it being a pro feature. On one hand, if it has no impact it's a bit disappointing not to have it as part of E2E in general. On the other hand, it doesn't change much as long as contents are encrypted and you need to monetize, so you have to find features that push people to the pro version.
It really depends on the perspective. There are no recurring costs once it's built, but it needs to be built first. Same applies to all of the features, yet collectively this app is more than a year of a senior engineering. In other words, since we're not hosting anything (almost, there are some convenience features, CORS proxy etc.) with the self-hosted, there are almost no other costs involved other than development.
Avatar
Indeed, I wrote that before seeing that was for self-hosted plans, and didn't correct afterward 😅
11:16 AM
Having an interesting enough free app for adoption, then interesting enough features to push to pro… tough balance indeed.
Avatar
The pro features pre-release is tied to the s3 key ID is that correct?
11:17 AM
So we cannot lose the ID-key pair
Avatar
Minor feedback, I would change the following text from: Hide "." files Show all files, including starting with the dot. Hide files starting with the dot character To: Hide dotfiles Show all files, including ones starting with a dot. Hide files starting with the dot character.
👍 1
Avatar
Avatar
zer0
The pro features pre-release is tied to the s3 key ID is that correct?
We've had to find some way to store the Pro features without an account, so yes we calculate hash based on the S3 key ID (we don't touch the key though). There are other components, e.g. installation ID. We're focusing on building stuff right now instead of complex licensing paywall APIs, eventually we will come up with a reasonable switch plan. We might even ditch the key IDs and simply base it on timestamp, not exactly sure. Costs of giving some licences even for free are way less than our time wasted on some licensing shenanigans... and developing paywalls is way less exciting than building out new features ! (edited)
Avatar
Avatar
Xenthys
If it's supposed to be a pro feature I don't mind paying for it, as simple as that. Giving a discount to early adopter is fine, but I wouldn't straight out retain used pro features.
That worked fine with previous subscription model that we were running, but combined with Perpetual licensing it didn't make much sense (to be honest we would have to build specific code to handle that), so current Early Adopters remain all of the features as if they bought it. We might change it, but this will affect future users. We can't break certain promises.
Avatar
If you reinstall the app or change your phone, you will lose your pro features. If you have a rooted phone, you can cheat the install date so it's not enough. While these are noble intentions, it will probably bite you in the ass from both sides in the end. Shelling out 10€/year is frankly nothing, unless you're a Turkey resident per example, but still if you need pro features then you supposedly have some infrastructure costs already. I'm putting my money where my mouth is, I just got a pro perpetual license, now I just need to check how to use it! doggokek
👍 1
Avatar
... and thank you guys for this feedback, it's really helpful for me. We're yet to find reasonable model. S3Drive is becoming tool that's used by different people with different use cases, we'll be making lots of adjustments to make most of the people happy.
Avatar
Putting a paywall on previously-free features is never recommended, so I get you, but you will always have someone complain about it.
Avatar
Avatar
Xenthys
If you reinstall the app or change your phone, you will lose your pro features. If you have a rooted phone, you can cheat the install date so it's not enough. While these are noble intentions, it will probably bite you in the ass from both sides in the end. Shelling out 10€/year is frankly nothing, unless you're a Turkey resident per example, but still if you need pro features then you supposedly have some infrastructure costs already. I'm putting my money where my mouth is, I just got a pro perpetual license, now I just need to check how to use it! doggokek
Thank you for the purchase, it really means a lot to us !
Avatar
I'd pay more for a lifetime license with all feature updates guaranteed lol (edited)
11:35 AM
That being said if it stays at 10€/year for life I'm fine with it
Avatar
Avatar
Xenthys
I'd pay more for a lifetime license with all feature updates guaranteed lol (edited)
The issue with lifetime that I have personally is defining the "lifetime". There are lots of cloud, VPNs or other products that you buy for approximately 3x the avg yearly subscription. Lifetime usually means lifetime of a company, product not necessarily your lifetime. Users don't like subscriptions and I get it, I don't like them myself. It's just this model allows us to finance development on the fly and make reasonable development decisions. It's easy to overspend: "lifetime" money which in theory shall be equally distributed for the lifetime of the project.
11:40 AM
I would hate to promise: "lifetime", only to shut down the project few years later. EDIT: Don't be worried, because we don't plan doing it and even if it happened, we would make it opensource: https://s3drive.app/faq?open=opensource (edited)
Avatar
Yeah I understand no worries, it's not even about the subscription because it's once a year so that's alright, I just hate having to update my card everywhere when it expires. It would be annoying to support SEPA direct debit on your end though, but that would solve my issue :D
Avatar
There will be more billing options available (including crypto). I am not a huge fan of Stripe, but it's extremely convenient to start with. SEPA is possible, but someone on our end would have to deal with it manually or we would have to find some partner which gives us nice API.
Avatar
I was also thinking about the file sharing expiration slider, and realised it will not fit all use cases if I want to create a URL that expires in 5 minutes or in an hour per example. Having a manual number input with a [(seconds /) minutes / hours / days] selection next to it would be the most granular approach even if it wouldn't look that good. Or 3 sliders, from 0 to 59 for minutes, 0 to 23 for hours, and 0 to 7 days. That would allow sharing for an hour and a half instead of having to put 90 minutes with the number input. Reset the previous sliders to 0 if you set the expiry to 7 days, which would also be the default expiry time like it is now. Having a more granular display could be behind the "Show advanced features" option we talked about, so that wouldn't clutter the interface for all users by default, but remain there if people want it.
11:49 AM
Now that I talked about it, I want raw pre-signed URLs and granular expiry sliders, ugh. How much would it cost to sponsor these features in priority?
Avatar
Avatar
Xenthys
Yeah I understand no worries, it's not even about the subscription because it's once a year so that's alright, I just hate having to update my card everywhere when it expires. It would be annoying to support SEPA direct debit on your end though, but that would solve my issue :D
I know that every country have some specifics about payment methods. There are certain providers that you can use which are integrated with many banks, so in principle no SEPA transfer is required, but more like user logging in to their bank account confirming some online payment. I am from Poland and there are Przelewy24, PayU and Blik. I know SOFORT being popular in Germany. Do you use any of these in your country?
Avatar
SEPA is convenient, but having dealt with them at my previous job, they're unfortunately a fraud territory I can't recommend. In France we just give an IBAN and swear it's ours, some providers request bank details, but fraudsters easily edit them anyway…
Avatar
Avatar
Xenthys
I was also thinking about the file sharing expiration slider, and realised it will not fit all use cases if I want to create a URL that expires in 5 minutes or in an hour per example. Having a manual number input with a [(seconds /) minutes / hours / days] selection next to it would be the most granular approach even if it wouldn't look that good. Or 3 sliders, from 0 to 59 for minutes, 0 to 23 for hours, and 0 to 7 days. That would allow sharing for an hour and a half instead of having to put 90 minutes with the number input. Reset the previous sliders to 0 if you set the expiry to 7 days, which would also be the default expiry time like it is now. Having a more granular display could be behind the "Show advanced features" option we talked about, so that wouldn't clutter the interface for all users by default, but remain there if people want it.
... so basically you would like an easier way to provide relative time for a shorter ranges e.g. few minutes, 30 minutes, 1h 20 etc.? (edited)
Avatar
I may or may not have edited one because I potentially wanted to pay for a non-profit's internet box subscription with my personal account, an the provider wanted the bank account to be in the name of the non-profit.
Avatar
Avatar
Tom
... so basically you would like an easier way to provide relative time for a shorter ranges e.g. few minutes, 30 minutes, 1h 20 etc.? (edited)
Absolutely, and more sliders is the easiest way I can think about to compound time that would please our human brains
11:57 AM
It might be the time to have a #technical channel, a #billing channel, and of course an #off-topic channel for everything else :D
11:58 AM
You could also throw some #support channel into the mix but it might overlap with the others and doesn't feel necessary yet (edited)
Avatar
Avatar
Xenthys
It might be the time to have a #technical channel, a #billing channel, and of course an #off-topic channel for everything else :D
That's a good idea, I was hesitant to create these categories, since I periodically do the snapshot of the whole discussion that I embed on website as sort of free SEO / uncategorized FAQ.
Avatar
Or just a forum channel with tags, then you can snapshot whichever post is of interest
Avatar
I think more channels sounds great.
Avatar
therefore only one forum is necessary since you can then filter by tag, which could be Development, Billing, Support… the sky's the limit
12:02 PM
As you prefer, it's your server :p
Avatar
I am a Discord noob, I will simply follow your advice 🙂
Avatar
Forums allow for multiple discussions in parallel, each of them being its own channel. It'd be nice for feature requests or specific topics I believe
12:05 PM
I'm a former moderator under NDA with Discord to setup servers like Square Enix before the E3 a few years ago, let me know if you have any question 😄
Tom started a thread. 4/27/2023 12:07 PM
Avatar
Avatar
Xenthys
I'm a former moderator under NDA with Discord to setup servers like Square Enix before the E3 a few years ago, let me know if you have any question 😄
That's quite an achievement !
Avatar
I'm proud to be a volunteer for projects and people I appreciate, but moderators are frequently seen as a necessary evil
👍 1
Avatar
Avatar
Xenthys
I'm proud to be a volunteer for projects and people I appreciate, but moderators are frequently seen as a necessary evil
I guess at certain scale no moderation leads to human nature taking over the channel, herd behavior and all sorts of stuff which is researched by many PhDs.
Avatar
Yeah, thanks to 4chan and unmoderated subreddits acting as research grounds haha
Avatar
Some people are also unable to act properly within communities, and either get banned all the time or wait until "moderators are asleep" to be active
12:34 PM
The most annoying members are the ones who test the limits of the rules, being annoying without directly breaking them, complaining about being unfairly banned if you ever remove them… they have too much time on their hands, welcome to the Internet I guess ;-;
Avatar
Avatar
Xenthys
The most annoying members are the ones who test the limits of the rules, being annoying without directly breaking them, complaining about being unfairly banned if you ever remove them… they have too much time on their hands, welcome to the Internet I guess ;-;
Reminds me of public service auditors, it's just they're pretty useful, as even though annoying to some, they're testing certain freedoms and the knowledge of law by those who enforce it.
Avatar
Well, auditors are not doing it to be annoying, some members on the other hand…
1:27 PM
Also, law is written by people who work in that field, it's a real mess and they have to cover every case. Discord server rules written by some dude who had some free time don't really have that requirement, especially if you want members to actually read them ablobsweats
Avatar
As long as the released features are stacked as per the FAQ, it's all good
2:50 PM
Question though, what happens if there is a gap between subscriptions? Can I pay for a year, stop paying, then resub when I feel like I need the new feature(s)?
2:52 PM
Or is it more like; keep all features accrued while continuous recurring payments, then those stacked features become permanent?
Avatar
If you stop paying I believe your license is still valid for the features that were released until it "expired" to give you only security updates
3:28 PM
Otherwise it wouldn't be called perpetual, and renewing it for a year would certainly update the list of features you're allowed to access
3:31 PM
@Tom how about just tying the "free pro features" to user accounts created before the end of the beta period? people who care about them can create a free account and be sure to retain them, you will only have to monitor for account sharing on your end, no more fiddling with access keys and all that
👍 1
3:32 PM
I assume the account I created and bought the license on is what will enable pro features on the app in the future, as long as I have a profile logged into my managed account
3:35 PM
cool checkmark, way better value than Twitter Blue lol
Avatar
+1, users may have to revoke old access keypairs and generate new ones for whatever reason
4:32 PM
A digitally signed text file that the app checks could work
Avatar
Avatar
zer0
Question though, what happens if there is a gap between subscriptions? Can I pay for a year, stop paying, then resub when I feel like I need the new feature(s)?
Yes, you can do that. The moment you resubscribe you will get current Pro features as part of your perpetual license. It's likely that there will be various incentives (e.g. continuity discount) to actually stay. Decision will always be yours though and whatever works for you better.
Avatar
Avatar
Xenthys
@Tom how about just tying the "free pro features" to user accounts created before the end of the beta period? people who care about them can create a free account and be sure to retain them, you will only have to monitor for account sharing on your end, no more fiddling with access keys and all that
Good idea. That seem to be fair compromise (user gets their freebie), but need to formalise this through registration, so we can handle that without too much technical drama. I like that so far.
Avatar
Avatar
Xenthys
cool checkmark, way better value than Twitter Blue lol
Thanks goes to Material iconset and to Twitter of course 🙂
Avatar
Avatar
zer0
A digitally signed text file that the app checks could work
Everytime I hear crypto, my heart beats faster 🙂 In theory this could work. Basically some private key hidden behind the API could generate a verifiable token which would be stored on the user's bucket (and likely device for little bit of redundancy) and could be then verified. The issue that I see so far is that not every user would want their bucket to be written to with some "licensing" file. (edited)
Avatar
If I have 5 profiles and 3/5 are read-only buckets, where do you store the license? :D
Avatar
Clearly solution isn't Web Scale https://www.youtube.com/watch?v=b2F-DItXtZs (edited)
Avatar
Having an S3Drive user account is the easiest, if one profile is connected to a paid or beta account then you're good, if you touch my buckets be warned I'm gonna bite doggokek
Avatar
Avatar
Xenthys
Having an S3Drive user account is the easiest, if one profile is connected to a paid or beta account then you're good, if you touch my buckets be warned I'm gonna bite doggokek
You can be proud of forcing us to modify improve our bucket validation method, so it's read only.
5:39 PM
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Avatar
For granularity you can "just" store a feature_flags int that computes to an array of pro features with bitwise operations, easy on your API and authentication gateway or whatever you do behind the scenes.
5:41 PM
Update the integer for all the active pro accounts every time you add a feature, done stickbug
Avatar
Avatar
Xenthys
For granularity you can "just" store a feature_flags int that computes to an array of pro features with bitwise operations, easy on your API and authentication gateway or whatever you do behind the scenes.
Yep, would work, unless we have more features than bitwise on INT allows. Regardless, this is an implementation detail.
Avatar
Avatar
Tom
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Update field type to bigint, done doggokek
5:46 PM
Erm, wrong message reply
Avatar
Avatar
Tom
I actually like it, less invasive, but still effective... and allows some weird use cases of bucket read-only access. Win for everyone.
Thank you for that, note that writing without explicit user consent could have legal repercussions depending on the buckets and their contents, it's a big no-no for S3 clients even though I understand your position 😅
shaileshchaudhary joined the server. 4/28/2023 3:41 AM
Avatar
Hi @shaileshchaudhary, welcome to the channel ! (edited)
klemer1001 joined the server. 4/29/2023 6:54 AM
Avatar
Hi @klemer1001, thank you for joining and welcome to S3Drive 📁 community !
Avatar
Avatar
Xenthys
Now that I talked about it, I want raw pre-signed URLs and granular expiry sliders, ugh. How much would it cost to sponsor these features in priority?
I think I've missed that comment, we've built the presigned URL option for you as requested and released that 13th of April, please find this announcement: https://discord.com/channels/1069654792902815845/1069654792902815848/1095920742182424646 We'll be able to get to Sliders eventually, I've set up the roadmap item just now: https://s3drive.canny.io/feature-requests/p/easier-way-to-set-up-relative-expiry-time-for-shared-links but we're slammed with other priority work. There are lots of stuff to finish before the holiday time where we'll relax for a short while. We're very much open for sponsorships (thanks !), on the other hand given the typical development time costs I don't believe I am able to provide reasonable offer for a single personal contributor. We're getting various feedback and improvements requests, some of them we're addressing on the fly, some of them will have to wait according to our priority list, some of them are not part of our general vision and unless there is shared interest, we'll be handling these via Enterprise package (e.g. https://github.com/s3drive/app/issues/23#issuecomment-1528861909). (edited)
mix9311 joined the server. 4/30/2023 1:15 PM
Avatar
Avatar
Tom
I think I've missed that comment, we've built the presigned URL option for you as requested and released that 13th of April, please find this announcement: https://discord.com/channels/1069654792902815845/1069654792902815848/1095920742182424646 We'll be able to get to Sliders eventually, I've set up the roadmap item just now: https://s3drive.canny.io/feature-requests/p/easier-way-to-set-up-relative-expiry-time-for-shared-links but we're slammed with other priority work. There are lots of stuff to finish before the holiday time where we'll relax for a short while. We're very much open for sponsorships (thanks !), on the other hand given the typical development time costs I don't believe I am able to provide reasonable offer for a single personal contributor. We're getting various feedback and improvements requests, some of them we're addressing on the fly, some of them will have to wait according to our priority list, some of them are not part of our general vision and unless there is shared interest, we'll be handling these via Enterprise package (e.g. https://github.com/s3drive/app/issues/23#issuecomment-1528861909). (edited)
Oh my, you're right, I didn't check since it wasn't mentioned but I can indeed see it! The date picker is just perfect on phone as well so no need for sliders there, last time I checked it was impossible to edit the expiry at all.
Avatar
Avatar
Xenthys
Oh my, you're right, I didn't check since it wasn't mentioned but I can indeed see it! The date picker is just perfect on phone as well so no need for sliders there, last time I checked it was impossible to edit the expiry at all.
Oh yeah, that's probably my Discord skills. Great to hear that you like this change.
Avatar
Avatar
Tom
Oh yeah, that's probably my Discord skills. Great to hear that you like this change.
I probably just missed it, no worries, thanks for letting me know! Unrelated, is it planned to get an official S3Drive logo? I don't know if the folder icon is yours or not, and it could fit any file storage service so it probably lacks a bit of personnality?
2:26 PM
I created the #support where people can post about topical matters, you can see the tags with little emojis which will allow everyone to filter posts once they start to flow in. I also added a "Developer Response" tag you can add to posts if you answer, allowing people to know where you've intervened, that's a common thing on Reddit and I loved the concept but let me know if you'd rather not have that.
2:28 PM
I can also add a "Confirmed" tag for bug reports per example, so you can say whether it's a confirmed bug or not, filtering with those two tags could allow people to immediately see a list of known bugs. EDIT: just added it, costs nothing and can be adapted on the fly if we ever need to change it (edited)
Avatar
Avatar
Xenthys
I probably just missed it, no worries, thanks for letting me know! Unrelated, is it planned to get an official S3Drive logo? I don't know if the folder icon is yours or not, and it could fit any file storage service so it probably lacks a bit of personnality?
Definitely, honestly the whole app is missing some nicer UI, branding and logo as you say. We're aware of this and current icon is pretty poor. We weren't making change to UI, being focused on the technology and functionality. I think it all comes down if split for S3Drive is required. We don't really know shall we keep the self-hosted and managed together as one product, one app. We might keep S3Drive as it is, focusing on S3 and have separate managed "Drive" product, this would affect branding, we don't know exactly at this stage what path this all will take. Regardless, S3Drive as it is will receive better logo and better icon 🙂 (edited)
Avatar
Cool, I like the profile system and believe it can remain a single app, and people who subscribe to even the lowest drive tier can have pro features imo
Avatar
Avatar
Xenthys
Cool, I like the profile system and believe it can remain a single app, and people who subscribe to even the lowest drive tier can have pro features imo
One app is slightly more complex technically, but definite less headache when managing updates, release, pipelines etc. Our goal is to rely on S3 protocol, so having one app actually helps us to stick to this goal and not diverge with some proprietary protocol. The only thing we need to think through is the clear marketing as what S3Drive is, as we're targeting different userbases, each of them having slightly different needs.
2:37 PM
I will get back on the Discord updates later, as I need to leave. Thanks for that ! (edited)
Avatar
Avatar
Xenthys
I created the #support where people can post about topical matters, you can see the tags with little emojis which will allow everyone to filter posts once they start to flow in. I also added a "Developer Response" tag you can add to posts if you answer, allowing people to know where you've intervened, that's a common thing on Reddit and I loved the concept but let me know if you'd rather not have that.
Thanks for that. I like it all and it's pretty neat. I think it's a great start for more organized workflow. (edited)
kuwaha7913 joined the server. 5/1/2023 11:22 PM
Avatar
Hi @kuwaha7913 and welcome to our little S3 world 👋
secrethash joined the server. 5/10/2023 8:16 AM
Avatar
Avatar
secrethash
Click to see original message
9:10 AM
Hey, I used the mobile application for Android. After successful login it shows this error and does not list the objects. MinioError: ListObjectsV2 search parameter maxKeys not implemented (edited)
9:10 AM
I am using Cloudflare's R2 S3 Compatible Object Storage.
Avatar
It looks like the app identifies Cloudflare R2 as a MinIO API, can you create a Bug Report post in #support please?
11:05 AM
If I'm right, that would mean S3Drive gets confused about which options are available and which aren't
Avatar
Avatar
Xenthys
It looks like the app identifies Cloudflare R2 as a MinIO API, can you create a Bug Report post in #support please?
Sure thing.
Avatar
Thanks!
Avatar
@everyone We've released new 📁 S3Drive version (1.2.5) on Web which uses improved rendering engine. Once it loads once all subsequent loads shall be much quicker and the UI shall be way more responsive. I would be glad to hear if you find it an improvement 🔥 (edited)
👍 1
kadircanersahin joined the server. 5/14/2023 11:07 AM
Avatar
Hi @kadircanersahin, welcome to our channel 👋
roaarr_44 joined the server. 5/18/2023 6:51 PM
Avatar
Avatar
roaarr_44
Click to see original message
Avatar
Hello, welcome!
Avatar
I am trying out S3drive on my iphone. I want to connect to an AWS bucket that I have created in my existing AWS account. (there are multiple buckets there). I can't figure out what I am suppose to enter under 's3-endpoint', and I tried everything. Can someone explain what I need to set up on AWS S3 and what I have to enter in the s3drive app under 's3-endpoint'?
Avatar
it should be given to you by AWS, but pretty much the region URL where the bucket is located
4:21 AM
it's formatted as s3.<region>.amazonaws.com
👍 1
GrahamC joined the server. 5/22/2023 2:56 PM
Avatar
Avatar
GrahamC
Click to see original message
Avatar
Hi @GrahamC, welcome 👋
Avatar
Has anyone managed to use the 'Upload folder's menu option ? I select the folder, select USE THIS FOLDER and ALLOW access, nothing then appears to happen. I don't think it is an Android file permission issue as uploads of the individual files in the folder work OK.
Avatar
If I select the Documents folder to upload instead of a sub folder it does upload just one file - but it is a file from the images folder not from the Documents folder.
Avatar
Selecting the camera images folder gives an exception.
Avatar
The Socket exception only happens on Cloud flare R2. But for other providers when I select upload the Documents folder it actually uploads the contents of Images/Documents. So it does look like a file permissions issue.
Avatar
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
Avatar
Avatar
GrahamC
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
Thanks for reporting this issue. We're trying to find a way to resolve permissions issues for folder upload. In principle access to files inside of the selected directory shouldn't require: "All files permission", however we're facing some limitations of the file related library that we use and we're working to overcome these problems. Yes, we could use, "All files permission", to get seamless access to files, but it's pretty powerful permission to grant and it's also hard to justify use of this permission when releasing app on Google Play.
Avatar
Avatar
GrahamC
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
We will be deploying some improvements to folder upload permissions later today / tomorrow (Release 1.2.10). It will be an improvement over what we have currently, but there are still couple underlying problems we are not able to easily address. Most importantly permissions shall work just fine for all types of files and instead of requesting ALL FILES permission we will be using SAF (https://developer.android.com/guide/topics/providers/document-provider) which is pretty much the only supported/approved of managing files for Android 11+ (edited)
Josh G joined the server. 5/24/2023 5:24 PM
Avatar
Avatar
GrahamC
Yes the app settings are 'allow access to media only'. I think this can only be extended to all files if the app configuration requests it.
This was successfully deployed. Unfortunately we're not supporting sub-folders (they will be skipped in the process), but we're working on improving that. I was wondering if this resolves your issue at least partially?
Avatar
Yes it fixed the problem.
👍 1
Buzz69 joined the server. 5/28/2023 7:40 PM
Avatar
Hi, ive just downloaded the app, its working ok on my android phone - i'm self hosting with xns relayer and its working without ssl (which obviously i don't want to continue with), but with self signed cert on its coming up with handshake error.. any ideas?
Avatar
very easy to use btw, great features coming down the road too..
Avatar
Avatar
Buzz69
Hi, ive just downloaded the app, its working ok on my android phone - i'm self hosting with xns relayer and its working without ssl (which obviously i don't want to continue with), but with self signed cert on its coming up with handshake error.. any ideas?
Hi @Buzz69, Just a question, did you add the self-signed certificate to your Android device? On Android 13, there is Settings -> Security and privacy -> Other security settings (Credential storage section) -> Install from device storage. There is also a guide, how to export certificate from a URL and import in on Android: https://coderwall.com/p/wv6fpq/add-self-signed-ssl-certificate-to-android-for-browsing#:~:text=Copy%20the.crt%20file%20to%20the%20root%20of%20the,should%20ask%20you%20to%20confirm%20the%20security%20exception.
Avatar
Brilliant thanks so much, I'll do this later and see if it works!
Avatar
getting this error, this is trying to connect to a bucket on the Windows desktop app (edited)
zer0main joined the server. 5/31/2023 12:25 PM
Avatar
Hi. I'm trying to connect to my Minio instance from Android S3Drive client but it doesn't work, fails with OS Error: CERTIFICATE_VERIFY_FAILED: self signed certificate. And I indeed have self-signed certificate but I followed your instructions from https://github.com/s3drive/app/issues/19 (https://proxyman.io/posts/2020-09-29-Install-And-Trust-Self-Signed-Certificate-On-Android-11) and my browser on Andriod recognizes this certificate (if I go to minio browser, my Chrome is fine with the cert). But S3Drive continues to fail with the same error. I'm using the latest version. (edited)
Avatar
Avatar
Ethan
getting this error, this is trying to connect to a bucket on the Windows desktop app (edited)
Hi @Ethan, In order to rule out any platform specific issues can you try to connect using S3Drive using different than Windows platform, e.g. your mobile phone or web? On Windows 11 when I try to connect to this endpoint using some made up credentials I get null response, which is somewhat expected. I would expect to get the SSL related error instead.
Avatar
I just tried it on my laptop and on an Android phone and it works perfectly as it should, that's so weird not sure why I was getting an SSL error on that computer I tried it on
Avatar
It's so nice to finally have a decent S3 client for mobile
3:49 PM
there were previously no good iOS clients and BucketAnywhere was an option on Android but it wasn't the most up to date, modern or intuitive thing to use and at times was a real pain
👍 1
Avatar
Avatar
zer0main
Hi. I'm trying to connect to my Minio instance from Android S3Drive client but it doesn't work, fails with OS Error: CERTIFICATE_VERIFY_FAILED: self signed certificate. And I indeed have self-signed certificate but I followed your instructions from https://github.com/s3drive/app/issues/19 (https://proxyman.io/posts/2020-09-29-Install-And-Trust-Self-Signed-Certificate-On-Android-11) and my browser on Andriod recognizes this certificate (if I go to minio browser, my Chrome is fine with the cert). But S3Drive continues to fail with the same error. I'm using the latest version. (edited)
Hi @zer0main, we've deployed some changes as per https://developer.android.com/training/articles/security-config guideline and released patch on Play Store. Can you please update and see whether it works for you? If for some reason there is still an issue in that area we will then test it thoroughly and come up with a fully fledged solution. Thanks !
Avatar
Avatar
Tom
Hi @zer0main, we've deployed some changes as per https://developer.android.com/training/articles/security-config guideline and released patch on Play Store. Can you please update and see whether it works for you? If for some reason there is still an issue in that area we will then test it thoroughly and come up with a fully fledged solution. Thanks !
I updated, same error. Or do I also need to add this xml config file somewhere?
Avatar
Avatar
zer0main
I updated, same error. Or do I also need to add this xml config file somewhere?
The file was on our side. Thanks for letting me know. In which case we'll be looking on this and hopefully by the end of this week will have it fixed. What's your Android version by the way? (edited)
Avatar
Avatar
Tom
The file was on our side. Thanks for letting me know. In which case we'll be looking on this and hopefully by the end of this week will have it fixed. What's your Android version by the way? (edited)
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
Avatar
Avatar
zer0main
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
Cool, so if we have it fixed we'll hopefully stand out 👍
Avatar
Avatar
zer0main
Android 13. I've tried many s3 client apps and none of them worked with self-signed cert.
In fact this one isn't easy. I've added the forum item to keep track of this, but this will have to wait until either Flutter team improves the framework or whether actually we have time to implement a workaround: https://discord.com/channels/1069654792902815845/1114132460989599774
rk̶ joined the server. 6/3/2023 6:02 AM
Avatar
Avatar
Tom
Hi @Buzz69, Just a question, did you add the self-signed certificate to your Android device? On Android 13, there is Settings -> Security and privacy -> Other security settings (Credential storage section) -> Install from device storage. There is also a guide, how to export certificate from a URL and import in on Android: https://coderwall.com/p/wv6fpq/add-self-signed-ssl-certificate-to-android-for-browsing#:~:text=Copy%20the.crt%20file%20to%20the%20root%20of%20the,should%20ask%20you%20to%20confirm%20the%20security%20exception.
Hi Tom, i've followed the guide but when i go to upload file in andriod phone its saying private key required to install certificate
11:31 AM
on android 13
Avatar
Hmm, that's odd, you shouldn't need the private key at all to trust a certificate, which is the actual point of using certificates… is your Android drunk? blobthonkang
Avatar
looks like it.. i'll give it a go on another phone..
Avatar
Avatar
Tom
In fact this one isn't easy. I've added the forum item to keep track of this, but this will have to wait until either Flutter team improves the framework or whether actually we have time to implement a workaround: https://discord.com/channels/1069654792902815845/1114132460989599774
Thanks. Yep, this is what I thought based on not having this feature in so many applications. Still, Chrome does it somehow.
Avatar
@Tom hi - using xns backup successfully on iOS and andriod, all working via https website which is great.. I appreciate the media backup is a new feature, just to note the 'backed up assets' no' isn't updating regularly in both iOS and android (but it is working in background i believe..).
Avatar
Avatar
Buzz69
@Tom hi - using xns backup successfully on iOS and andriod, all working via https website which is great.. I appreciate the media backup is a new feature, just to note the 'backed up assets' no' isn't updating regularly in both iOS and android (but it is working in background i believe..).
That's great ! Thanks for letting me know. We'll have a look on the counter issue. Speaking of background upload it's not yet implemented. We've already got a working prototype on Android, but we're still finding best ways for background sync on iOS. There will certainly be improvements in that area.
7:37 AM
Hi @keiko, welcome to the channel !
Avatar
Background will be excellent 👍
Arwen joined the server. 6/13/2023 5:07 AM
Fuwa2Tofu joined the server. 6/13/2023 11:27 AM
Deleted User joined the server. 6/18/2023 8:49 PM
Avatar
Deleted User 6/18/2023 8:49 PM
hi! just wondering if S3Drive is fully open source? i don't see source code on github
Anon ID Mars joined the server. 6/19/2023 4:23 AM
Avatar
Avatar
Deleted User
hi! just wondering if S3Drive is fully open source? i don't see source code on github
Hi @Deleted User , please find more about that in our FAQ: https://s3drive.app/faq?open=opensource
Avatar
Hi @Tom, you may want to use #changelog for releases :p
1:26 PM
you can also name yourself "Tom" since you'e already singled out as the S3Drive developer hehe
Avatar
Avatar
Xenthys
you can also name yourself "Tom" since you'e already singled out as the S3Drive developer hehe
Thanks for that. Can I move this post or rather delete and add again?
Avatar
you will have to repost there, Discord doesn't support moving messages
Avatar
Cool, it's been a while, I've already forgot the rules and improvements that we've got here ! 🙂
Avatar
I don't think anyone follows that channel elsewhere but I published the messages in order, nice thing to do!
1:29 PM
we haven't taken time to talk together yet haha, we should probably do it someday
VERZEN joined the server. 6/22/2023 5:00 PM
Avatar
Hi @VERZEN 👋
Henrik V joined the server. 6/24/2023 8:39 AM
Avatar
hi @Tom i've completed a guide for XNS/S3Drive attached. Let me know if you have any comments. thanks
gcasale joined the server. 6/24/2023 6:49 PM
Avatar
Avatar
Buzz69
hi @Tom i've completed a guide for XNS/S3Drive attached. Let me know if you have any comments. thanks
Hi @Buzz69 , cool. I am happy to see S3Drive being positioned closely to one of the S3 providers. That's the whole idea and beauty of S3 protocol. 🔥 Multiple clients (S3Drive being one of them) and multiple back-ends, all speaking 🗣️ the same language. If you need my input on anything, just let me know !
Avatar
Cool, I was just asking in case you wanted me to add anything etc.. if all good then great 👍
Avatar
@Tom also happy to discuss further collaboration in terms of supporting your offer in terms of storage. I can get you storage costs very low or zero in certain configs if you become a provider. Can talk you through how if you are available for a call. Cheers
Markus Berthold joined the server. 6/29/2023 6:57 AM
horizon joined the server. 6/30/2023 3:16 AM
Avatar
S3Drive such an awesome app. Just joined discord server to thank the development team.
Avatar
Hi, agreed, I initially did the same :D
Avatar
Avatar
horizon
S3Drive such an awesome app. Just joined discord server to thank the development team.
Thanks for these kind words. Given an opportunity to ask, is there anything that annoys you with S3Drive or perhaps some aspect you would like us to improve or implement?
Avatar
Markus Berthold 6/30/2023 10:57 AM
@Tom where should I report bugs? The followings fails: If a bucket has object lock and versioning enabled and a file already exists, an upload of an updated file (via menu or drag and drop) file fails. In the log the following error is logged:
11:01 AM
The upload was done as the bucket root user.
Avatar
Markus Berthold 6/30/2023 11:30 AM
Since then no new upload works.
Tom started a thread. 6/30/2023 11:49 AM
2:55 PM
I don't know what to name it, because support-bugs-requests is too long but there's no reason to have multiple channels for that either
2:55 PM
looks like #general works well due to low activity, but osoner or later we'll have to set topics
Avatar
Avatar
Xenthys
😭
It's my fault again. I shouldn't have continued conversation, but start a new one at @support. It would be way easier if I could simply create the thread in a desired location. It's hard to expect that any newcomer will automatically start discussion in a right place. (edited)
Avatar
It's fine, I mean, if we want people to follow some kind of rule we should write something in #rules to begin with :D
Tamaraa joined the server. 7/3/2023 11:13 AM
Avatar
Avatar
Tom
That's great ! Thanks for letting me know. We'll have a look on the counter issue. Speaking of background upload it's not yet implemented. We've already got a working prototype on Android, but we're still finding best ways for background sync on iOS. There will certainly be improvements in that area.
hi Tom, any news on background backup?
Avatar
Avatar
Buzz69
hi Tom, any news on background backup?
Hi, not much progress on that, as there are couple of outstanding items / E2EE base layers that we've had to finally tackle as it was blocking our other items. End of this month we'll have retrospective internally and will plan remaining year. It also seem that ordering and ZIP downloads are higher on the list: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified https://s3drive.canny.io/feature-requests/p/add-support-for-folder-zip-download (edited)
Avatar
Avatar
Buzz69
hi Tom, any news on background backup?
We're also improving upload resilience, error handling and retry methods. 👷 It make sense to apply these improvements before focusing on background upload, so there is a stable base.
JH joined the server. 7/7/2023 11:08 AM
Avatar
Avatar
Tom
Hi, not much progress on that, as there are couple of outstanding items / E2EE base layers that we've had to finally tackle as it was blocking our other items. End of this month we'll have retrospective internally and will plan remaining year. It also seem that ordering and ZIP downloads are higher on the list: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified https://s3drive.canny.io/feature-requests/p/add-support-for-folder-zip-download (edited)
Ok, makes sense, but i will be brutally honest with you, the phone app is not really something people will use without background, the reality is even leaving the app on the upload tends to stop shortly after the phone goes into energy save mode. I appreciate you have other priorities though!
Avatar
Avatar
Buzz69
Ok, makes sense, but i will be brutally honest with you, the phone app is not really something people will use without background, the reality is even leaving the app on the upload tends to stop shortly after the phone goes into energy save mode. I appreciate you have other priorities though!
I somewhat agree with you, but there is so much we can do. Stuff that's being worked applies to all platforms. Platform specific improvements come later. Even if this comes at some cost to Android's userbase, we're still improving platform as a whole. Our statistics prove that each day we're having more and more users (including Android) and getting mostly positive reviews which makes us feel that our technical decisions aren't that bad. We're applying method of quick wins and focusing on things which have the best balance of benefit to the community vs development cost. Background upload is really useful, at the same time it's not entirely cheap from a development point of view, especially that you need to do build it separately on Android and iOS. Sorry if this doesn't satisfy your current needs, we will get to that I can promise.
Avatar
I appreciate this is a work in progress and you will have far more insight on what needs doing.. this is just from user perspective. Looking forward to this coming down the line though
👍 1
Avatar
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
Avatar
Avatar
Xenthys
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
There a multiple user bases that use S3Drive with different use cases and needs and we're happy to accommodate most of them. Some people are interested in the encryption, some just want the mobile clients, some are looking to backup their photos, some are looking for general S3 file browser ... or better web interface to S3. Did I miss anything? 🙂 (edited)
Avatar
Avatar
Xenthys
I wanted to manage my buckets on Android, while my use case is niche it does the job for me :p
Interestingly, we're getting more requests from companies / hosting providers that are interested in our solution our would like to use S3Drive in their clouds. We're welcoming new business partners and integrations. Just recently we've made a move to stay compatible with Rclone which will further improve and open-up the ecosystem: https://rclone.org/crypt (edited)
Havilah joined the server. 7/11/2023 5:56 AM
sanrinconr joined the server. 7/11/2023 6:31 PM
Avatar
Rclone crypt sounds interesting
👍 1
Avatar
Avatar
zer0
Rclone crypt sounds interesting
It's going to be a major release which we plan to push as early as next week. Stay tuned for Rclone compatibility, filepath encryption, drive mount, multipart upload, web support for bigger files and many smaller yet important improvements. (edited)
👍 2
Deleted User joined the server. 7/14/2023 2:25 AM
Avatar
@Tom I cannot update the new release on Android or IOS, says i'm currently v1.3.1 which is no longer supported, go back to delete and download, then comes back with exact same error.
Avatar
Avatar
Buzz69
@Tom I cannot update the new release on Android or IOS, says i'm currently v1.3.1 which is no longer supported, go back to delete and download, then comes back with exact same error.
We've planned the forced upgrade on all platforms (due to encryption scheme upgrade), however faced some technical issues which combined with the App Store and Google Play processing delays lead us ultimately to this mess. We hope that within few hours Google Play issue will be resolved and subsequently the App Store. I am really sorry for this issue to happen, but with mobile clients we're now at mercy of prompt review time from both Google and Apple side. In the meantime please fallback to desktop or web client, where update was delivered immediately. (edited)
Avatar
ok thanks for the info, just checking you were aware really. thanks
sutraman joined the server. 7/22/2023 1:02 PM
Avatar
Our iOS release was just approved and shall appear on the App Store within minutes. We're still waiting for the Google Play team to approve our release.
👏 1
Avatar
Must be stressful dealing with the faceless giants…
Jeyso joined the server. 7/22/2023 7:33 PM
Bituhh joined the server. 7/22/2023 10:35 PM
Avatar
that's why we need decentralisation!
Avatar
feels like a hopeless dream nowadays
Avatar
Avatar
Xenthys
Must be stressful dealing with the faceless giants…
It is indeed. Just to give you an idea, one of the reasons that we've decided to ship macOS app via .DMG from our website is long review times and multiple issues related to the fact that our iOS / macOS app are linked forever (due to https://developer.apple.com/support/universal-purchase/ thing). When we've introduced payments on iOS, our macOS releases were blocked and subject to same scrutiny, rules and reviews even though we didn't want to introduce these for macOS in a same way as for iOS. ... fast forward few months, our .DMG release is currently broken for a few days already, because Apple Notary process stopped working for no apparent reason (screenshot attached). Their official channel says that it's not a technical issue, but instead their Developer Programs Support needs to be contacted: https://developer.apple.com/forums/thread/118465 We've contacted them and they replied with generic info how to troubleshoot notarization issues, ignoring the fact that error specifically mention that they need to do something on their side. Without notarized .DMG user needs to explicitly allow the app to run... but that's least of a trouble. Even if app starts it has no access to Keychain, meaning no S3 login data can be stored securely... rendering S3Drive pretty much useless. We've kindly replied and waiting for their action. Not really much we can do. Fun fun fun 🙂
bongosmash 1
storj-derek joined the server. 7/27/2023 8:18 PM
Avatar
ooooh storj, hello
Avatar
Hi Derek !
Avatar
Avatar
Tom
It is indeed. Just to give you an idea, one of the reasons that we've decided to ship macOS app via .DMG from our website is long review times and multiple issues related to the fact that our iOS / macOS app are linked forever (due to https://developer.apple.com/support/universal-purchase/ thing). When we've introduced payments on iOS, our macOS releases were blocked and subject to same scrutiny, rules and reviews even though we didn't want to introduce these for macOS in a same way as for iOS. ... fast forward few months, our .DMG release is currently broken for a few days already, because Apple Notary process stopped working for no apparent reason (screenshot attached). Their official channel says that it's not a technical issue, but instead their Developer Programs Support needs to be contacted: https://developer.apple.com/forums/thread/118465 We've contacted them and they replied with generic info how to troubleshoot notarization issues, ignoring the fact that error specifically mention that they need to do something on their side. Without notarized .DMG user needs to explicitly allow the app to run... but that's least of a trouble. Even if app starts it has no access to Keychain, meaning no S3 login data can be stored securely... rendering S3Drive pretty much useless. We've kindly replied and waiting for their action. Not really much we can do. Fun fun fun 🙂
In the meantime this have been passed to Senior Support (hello Mari) team which asked yet again to provide full description of the issue in a format they've requested. After a day of silence they've wanted "screenshot" of an error, as if pixels contained more ASCII data than the text I've provided. I am replying as fast I can, but it seems that error: "Team is not yet configured for notarization. Please contact Developer Programs Support" is not that easy to fix on their side. Well... 🍏
11:59 PM
Nice to see new features
11:59 PM
Possible to get a temporary pro sub to test things out?
Avatar
Hi @zer0, thanks ! What platform(s) are you using? I could send you the promo code for Android. Web has no paywall at the moment. Other platforms require registering an account. Since we're closely integrated with Stripe we don't yet have a workflow for "enabling Pro" outside of it, however if you get it, I could offer you a refund once you're done testing.
Kakarot1925 joined the server. 7/29/2023 8:39 AM
Avatar
Hi @Kakarot1925, welcome to S3Drive !
Avatar
Avatar
Tom
Hi @zer0, thanks ! What platform(s) are you using? I could send you the promo code for Android. Web has no paywall at the moment. Other platforms require registering an account. Since we're closely integrated with Stripe we don't yet have a workflow for "enabling Pro" outside of it, however if you get it, I could offer you a refund once you're done testing.
I do use Android
Avatar
Avatar
zer0
I do use Android
Cool, I've sent you the code, if you need anything just let me know.
Chernsha joined the server. 7/29/2023 10:33 AM
Avatar
The new rclone stuff is nice
👍 1
12:52 PM
Will test large file downloads from browser
Avatar
Hmm I cannot seem to access the files using rclone
1:24 AM
What's the correct way to configure?
Tamara joined the server. 7/30/2023 2:28 AM
Avatar
Avatar
zer0
Hmm I cannot seem to access the files using rclone
If you use mount feature on Desktop you can find the exact commands in the application logs. If file content encryption together with filename encryption is used, then please find below sample config. # Obscure password echo "YourPlaintextPassword" | rclone obscure - # Add it to Rclone config, config file location: `rclone config file` [s3drive_remote] type = s3 provider = Other access_key_id = <access_key_id> secret_access_key = <secret_access_key> endpoint = <endpoint> region = <region> [s3drive_crypt] type = crypt filename_encoding = base64 remote = s3drive_remote:<bucket_name> password = <obscuredPassword> filename_encryption = standard directory_name_encryption = true suffix = none Then you can use: s3drive_crypt as your remote encrypted location. Please note that whilst we support both encrypted and unencrypted files in the same location, Rclone doesn't seem to like the mix and won't display existing unencrypted files for the encrypted remote. In such case it's better to either keep everything encrypted globally or have dedicate paths with encrypted-only or unencrypted-only files. (edited)
👍 1
Morethanevil joined the server. 7/31/2023 6:40 AM
Deleted User joined the server. 7/31/2023 9:10 AM
Avatar
Avatar
Deleted User
Click to see original message
Deleted User 7/31/2023 9:10 AM
Sticker
Avatar
Avatar
Deleted User
Click to see original message
Morethanevil 7/31/2023 9:53 AM
9:53 AM
Hi 🙂
Avatar
just on the encryption theme, i don't know what the process is so this might seem a newbie question, but i'm assuming if you encrypt and access your bucket on a mobile device, then goto the desktop and use the same pw etc and try and view the mobile encrypted data you can do that? ie the key to decrypt is with the id and pw so is interchangeable between devices?
Avatar
Morethanevil 7/31/2023 9:54 AM
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Avatar
Avatar
Buzz69
just on the encryption theme, i don't know what the process is so this might seem a newbie question, but i'm assuming if you encrypt and access your bucket on a mobile device, then goto the desktop and use the same pw etc and try and view the mobile encrypted data you can do that? ie the key to decrypt is with the id and pw so is interchangeable between devices?
Yes
👍 1
Avatar
Avatar
Morethanevil
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Play store only unlocks android app
Avatar
Okay so I can not create an account in the app with pro enabled and link it to desktop app?
Avatar
Avatar
Morethanevil
I have a question about the pro version.. I bought it via Playstore and now I wanted to know, how I can connect the desktop app to it?
Hi and thank you for supporting us. It seems you've bought the Pro just on Android. If you need Pro working on all devices you would need to register an account and buy it through our website. When you use that account on any device it will obtain the license from our server and enable you the Pro. For iOS/Android, we as a developer were forced to use respective in-app payments, by default that's assigned to your Apple/Google account and it's not visible on other S3Drive clients. We haven't implemented any propagation mechanism and weren't sure about the exact approach. Speaking of how you manage credentials between devices, at the moment they need to be manually copied over, but we're looking to improve that: https://s3drive.canny.io/feature-requests/p/qr-code-credentials-exchange If you're not happy with your purchase, I could make an exception and we could switch the "plans" over.
Avatar
Avatar
Morethanevil
Okay so I can not create an account in the app with pro enabled and link it to desktop app?
It may work like that in the future, but that's not the case yet... and even if it was, the price would have to be different as technically you would buy lifetime version on all devices. The difference is that on our website we sell perpetual fallback license, whereas on iOS/Google we're forced (EDIT: well there are also subscriptions, but there isn't concept of perpetual fallback license - https://s3drive.app/faq?q=perpetual as such) to sell the lifetime with their 15% cut. (edited)
Avatar
Thanks for the explanation, I will wait for QR Code feature, it is the easiest way atm. I got a warning after executing the installer from windows defender.
10:58 AM
For the Linux version Flatpak would be nicer than appimage, because it is updateable
Avatar
Avatar
Morethanevil
Thanks for the explanation, I will wait for QR Code feature, it is the easiest way atm. I got a warning after executing the installer from windows defender.
Microsoft implements some heuristic mechanism to flag the executable if not enough people used the package. We've recently switched location of where we host our packages to Github release: https://github.com/s3drive/app/releases It might go away eventually, we're also thinking of buying "trusted certificate" from some provider, which should mitigate these warnings sooner. Alternatively you can use MSIX package, but we update it rarely due to pretty crappy experience with Microsoft Store: https://apps.microsoft.com/store/detail/s3drive-cloud-storage/9NX2DN9Q37NS (edited)
Avatar
Ahh cool, please link the store app on github too 🙂
Avatar
Avatar
Morethanevil
For the Linux version Flatpak would be nicer than appimage, because it is updateable
Flatpak is pending: https://github.com/flathub/flathub/pull/4364 however there is some licensing stuff we're not sure about and didn't have time to do the legal research. It will come probably in a few weeks. (edited)
Avatar
Flatpak is as great as the store app. They can selfupdate, so it is easier to manage versions. You can be listed on flathub too
11:03 AM
= more users 😄
Avatar
Avatar
Morethanevil
Flatpak is as great as the store app. They can selfupdate, so it is easier to manage versions. You can be listed on flathub too
Yes, we think the same. It's just there are two ways the "proprietary" packages can be distributed and the technical approach is quite different. One way or another, it will appear on Flathub. As you say more users and pretty convenient to distribute.
👍 1
Avatar
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Avatar
Avatar
Morethanevil
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Point taken. We'll have it updated, as the version is quite old.
☺️ 1
Avatar
Avatar
Morethanevil
I installed the store app, works perfect without warnings. Should be the prefered method for installing, and exe for people who don't like the store
Just to give you an idea, how we love this process. This is the first hand experience trying to login to dev account:
Avatar
After clearing cookies different one. Sorry, I've just had to vent 🙂
Avatar
If it don't works as expected, than add a hint about the warning from the installer. A notice is better than a surprise i think 🤔
👍 1
Avatar
Morethanevil 8/1/2023 8:49 PM
Just hot the new update on Android, thanks 😁 I will try out ☺
Avatar
Morethanevil 8/2/2023 6:36 AM
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
6:40 AM
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
6:41 AM
Import / Export settings would be great in this case 😄
Avatar
Avatar
Morethanevil
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
Avatar
Avatar
Morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
In principle this shouldn't happen, the E2EE settings regardless of UI are applied per S3 credentials separately. If your other credentials are lost, well it sounds like we may've screwed up. I am going to reproduce it. Is this Android?
Avatar
Avatar
Morethanevil
Import / Export settings would be great in this case 😄
It will definitely come soon.
Avatar
Avatar
Morethanevil
Update works well so far, but I don't get the E2EE running. I set a new crypt in rclone, with only one password, since s3drive does not support 2 passwords. I set filenames and directory names to encrypt too. Then I added the bucket to the app and activated the encryption with the same password. I get access, but folders and filesnames stay encrypted. Did I miss something? Then I saw that my other buckets are missing in the app, after I added the encrypted one. The profiles got overwritten. Securitysettings should be moved to bucket settings, since they only apply to the current bucket. It is a little confusing at first. Dark mode and dotfiles are appwide settings.
For the 2nd password, I've just added this item: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password Rclone support is still "hot" and our aim was to deliver MVP with contents, filepath encryption and drive mount. We also hope that we'll be able to influence Rclone crypt improvements first, as it would affect the end derived key for the file encryption: https://github.com/rclone/rclone/issues/7192 (edited)
Avatar
Avatar
Morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
When you say: "Since it did not work", at the moment when you enable/disable filename encryption and go back to the listing, you need to explicitly refresh it on the S3Drive side in order for changes to be applied to your existing already loaded listing. This will get improved as well, so it's less confusing. (edited)
Avatar
Avatar
Tom
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
Morethanevil 8/2/2023 9:34 AM
It works now, second notice was the hint from the app to encode the password in base64 using https://www.base64encode.org and then enter the password as base64, not plaintext. Is there a possibilty to enter a plain password, which is then calculated in base64?
Encode to Base64 format or decode from it with various advanced options. Our site has an easy to use online tool to convert your data.
Avatar
Avatar
Tom
In principle this shouldn't happen, the E2EE settings regardless of UI are applied per S3 credentials separately. If your other credentials are lost, well it sounds like we may've screwed up. I am going to reproduce it. Is this Android?
Morethanevil 8/2/2023 9:34 AM
Yes Android Playstore release from yesterday
Avatar
Avatar
Tom
For the 2nd password, I've just added this item: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password Rclone support is still "hot" and our aim was to deliver MVP with contents, filepath encryption and drive mount. We also hope that we'll be able to influence Rclone crypt improvements first, as it would affect the end derived key for the file encryption: https://github.com/rclone/rclone/issues/7192 (edited)
Morethanevil 8/2/2023 9:35 AM
One password is okay for the beginning, it works now. Maybe a quickstart guide with screenshots would be nice, so people can reproduce
Avatar
Avatar
Morethanevil
It works now, second notice was the hint from the app to encode the password in base64 using https://www.base64encode.org and then enter the password as base64, not plaintext. Is there a possibilty to enter a plain password, which is then calculated in base64?
Yes, please click: "Start" instead of "Existing key (base64)". The existing key is legacy option from previous AES-GCM encryption. It will work for Rclone if you properly encode your password, but it's mostly to satisfy previous user password if they want to decrypt files encrypted using legacy encryption.
Avatar
Avatar
Morethanevil
One password is okay for the beginning, it works now. Maybe a quickstart guide with screenshots would be nice, so people can reproduce
We're working on some documentation pages and tutorials using: https://squidfunk.github.io/mkdocs-material/ It wasn't our priority when features API wasn't exactly stable, but now things are getting final shape.
👍 1
Avatar
Avatar
Tom
Yes, please click: "Start" instead of "Existing key (base64)". The existing key is legacy option from previous AES-GCM encryption. It will work for Rclone if you properly encode your password, but it's mostly to satisfy previous user password if they want to decrypt files encrypted using legacy encryption.
Morethanevil 8/2/2023 9:37 AM
I thought start would setup a new password and encryption. This is why i used existing 😄
Avatar
Avatar
Tom
Thanks for your input. Please find the other post with sample Rclone config: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 For filename encryption to work, please make sure that these two landed in your settings: filename_encoding = base64 suffix = none By default the Rclone's encoding is base32: https://github.com/rclone/rclone/blob/88c72d1f4de94a5db75e6b685efdbe525adf70b8/backend/crypt/crypt.go#L140 unless overriden by the config creator.
BTW. I am wondering in the end if you had to set Base64 encoding (in the Rclone config) explicitly or was it already set by the Rclone's config creator? (edited)
Zev joined the server. 8/2/2023 10:06 AM
Avatar
Welcome @Zev 👋 (edited)
Avatar
Avatar
Tom
BTW. I am wondering in the end if you had to set Base64 encoding (in the Rclone config) explicitly or was it already set by the Rclone's config creator? (edited)
Morethanevil 8/2/2023 10:29 AM
The config creator uses base32 as default, as you said before. It only shows options if you say yes to the advanced configuration when creating the config file
Avatar
Morethanevil 8/2/2023 10:41 AM
Just ran the configuration assistant
Avatar
Avatar
Morethanevil
Just ran the configuration assistant
Great, so indeed possible.
Avatar
Avatar
Morethanevil
Steps to reproduce on the missing profiles: I already had unecnrypted buckets. I added another one and set encrypted with password from rclone. Since it did not work, I tried to toggle off and on again to set the password again (Maybe I mistyped) and then the other buckets were gone
There is a concurrency issue combined with a bug in library that we use: https://pub.dev/packages/flutter_secure_storage. When setting E2E password, we run the key derivation: https://rclone.org/crypt/#key-derivation which takes some xxx ms. When user taps/clicks on password confirmation, more than once, this all starts over and chances are it will clean up the other credentials. We need to apply quick workaround first, so we have time to properly fix this in the underlying library. (edited)
Avatar
Avatar
Tom
There is a concurrency issue combined with a bug in library that we use: https://pub.dev/packages/flutter_secure_storage. When setting E2E password, we run the key derivation: https://rclone.org/crypt/#key-derivation which takes some xxx ms. When user taps/clicks on password confirmation, more than once, this all starts over and chances are it will clean up the other credentials. We need to apply quick workaround first, so we have time to properly fix this in the underlying library. (edited)
Morethanevil 8/2/2023 10:48 AM
I will setup the buckets again and start with the encrypted one 😄
10:49 AM
But it is great that you found the bug, so a workaround or fix can be made
10:53 AM
I wanted to use my backups a better way than just rclone via sftp. So I learned about MinIO with Versioning and so on... It is a little tricky to bind a user to a bucket but I found a solution for this. Then I wanted to use S3 on android too, but there were no good apps. Mostly they only work with AWS, your app was the first one which worked and has not a UI from the 1990. Now with the encryption and the app, I am able to restore files and Folders without copy rclone.conf over, than run a long mounting and hoping to get my file
Avatar
Avatar
Morethanevil
I wanted to use my backups a better way than just rclone via sftp. So I learned about MinIO with Versioning and so on... It is a little tricky to bind a user to a bucket but I found a solution for this. Then I wanted to use S3 on android too, but there were no good apps. Mostly they only work with AWS, your app was the first one which worked and has not a UI from the 1990. Now with the encryption and the app, I am able to restore files and Folders without copy rclone.conf over, than run a long mounting and hoping to get my file
Great to hear, I am amazed to see that there are so many different user stories with S3Drive. Speaking of "bind a user to a bucket", is it something you would like to share more about? Is it MinIO specific or something we could help with S3Drive as well?
Avatar
Morethanevil 8/2/2023 11:00 AM
It is for MinIO only, the user managment is aweful there 😄
11:00 AM
Every user with read write can create and delete every bucket.
11:00 AM
Useful ACLs are missing
11:00 AM
But it is possible via JSON Format to bind a user to one bucket, I was looking around last night and finally found a solution in a blogpost
11:01 AM
Minio is a really cool opensource project which democratizes cloud storage. The feature that I love most about it is S3 compatibility which means that you ca...
11:01 AM
{ "Version": "2012-10-17", "Statement": [ { "Action": [ "s3:ListBucket", "s3:PutObject", "s3:GetObject", "s3:DeleteObject" ], "Effect": "Allow", "Resource": [ "arn:aws:s3:::BUCKET-NAME/*", "arn:aws:s3:::BUCKET-NAME" ], "Sid": "Description" } ] }
11:01 AM
Please copy from the blog, not discord 😄
11:01 AM
Discord always screws up
11:02 AM
As for S3 Drive it could check the permissions from the user and do an autodiscovery for the buckets. Then the user could select the ones to have in the app
11:03 AM
The only thing to do would be setup the passwords for encrypted buckets
11:03 AM
Serverside encryption is aweful too in minio, you need a kms 🙃
Avatar
Avatar
Morethanevil
It is for MinIO only, the user managment is aweful there 😄
I see, I believe Minio's goal was to build a replacement for AWS S3, with all of the IAM / KMS clunky, but enterprise-ready stuff
Avatar
Avatar
Morethanevil
As for S3 Drive it could check the permissions from the user and do an autodiscovery for the buckets. Then the user could select the ones to have in the app
On the S3 login screen you can select single bucket manually, but autodiscovery sounds also interesting. Technically we could ask user (dialog) and import all buckets as separate profiles (or perhaps there is a neater way to manage it). (edited)
Avatar
Morethanevil 8/2/2023 11:05 AM
A policy generator for the json files would be cool from the devs... selecvt user, select bucket, select ACL...
Avatar
Avatar
Tom
On the S3 login screen you can select single bucket manually, but autodiscovery sounds also interesting. Technically we could ask user (dialog) and import all buckets as separate profiles (or perhaps there is a neater way to manage it). (edited)
Morethanevil 8/2/2023 11:06 AM
If you use more than 5 buckets it is a little work to add them all, and retype the credentials everytime 😄
Avatar
Avatar
Morethanevil
If you use more than 5 buckets it is a little work to add them all, and retype the credentials everytime 😄
Avatar
Morethanevil 8/2/2023 11:12 AM
Thanks ☺️ I upvoted
Avatar
if you want a self-service MinIO policy: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}" ] }, { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}/*" ] } ] }
11:13 AM
that's what I always add to any MinIO instance I configure, full control over your own bucket that's your username
Avatar
Morethanevil 8/2/2023 11:20 AM
And it only allows the user to use his own buckets?
Avatar
only a single bucket that is their own username
11:42 AM
they can even delete it or create it if it doesn't exist
11:44 AM
you can always replace ${aws:username} by anything you want, be it a variable or a fixed bucket name, there unfortunately isn't any group name variable
Avatar
Morethanevil 8/2/2023 11:45 AM
So the first aws:username means the username of the user and the second one is for the bucket? I am not much into the policy thing, the docs are not very userfriendly 😅
Avatar
no, both time it's the bucket name
11:45 AM
the policy can be assigned to either a user or a group
11:46 AM
in my case I have a users group to which I assign the selfservice policy, then I add whoever I want to the users group and they'll be able to manage their very own bucket
Avatar
Morethanevil 8/2/2023 11:46 AM
Okay so the only difference to the other would be, that your json provides full access to the bucket, including deletion and creation
Avatar
it can be simplified a lot actually, I kept the resources separate but you can merge them
Avatar
Avatar
Xenthys
you can always replace ${aws:username} by anything you want, be it a variable or a fixed bucket name, there unfortunately isn't any group name variable
Morethanevil 8/2/2023 11:47 AM
That's cool ☝🏻 One policy for a group and then just add users
Avatar
{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}", "arn:aws:s3:::${aws:username}/*" ] } ] }
11:48 AM
by default I don't merge them because the first resource is the bucket itself, while the other is for its content
11:51 AM
I also had a "public-ro" and a "public-rw" policy, useful if you want all users to be able to access a common bucket but only allow a subgroup to write there
Avatar
Avatar
Morethanevil
Okay so the only difference to the other would be, that your json provides full access to the bucket, including deletion and creation
yeah, I'm afraid the one you sent doesn't allow multiparts or versions usage, it also allows users to set policies on their buckets if they want to allow other users to access it, or make a directory public
Avatar
Morethanevil 8/2/2023 12:04 PM
I will try this after work, thank you 😺
Avatar
Avatar
Xenthys
if you want a self-service MinIO policy: { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}" ] }, { "Effect": "Allow", "Action": [ "s3:*" ], "Resource": [ "arn:aws:s3:::${aws:username}/*" ] } ] }
Morethanevil 8/2/2023 12:04 PM
Username needs to be replaced with an existing bucket? How do I use this with groups?
Avatar
no, that one can be used as-is
12:05 PM
MinIO will interpolate the variable itself with the username of whichever user performs the API call
12:06 PM
the policy has the exact same effect whether it's assigned to a group to which your user belongs, or to the user directly (edited)
Avatar
Morethanevil 8/2/2023 12:15 PM
Okay create a policy "selfmanagment" and add users to it, then they can manage only themselfs Can they create more than one bucket for themself or only just one with their username as mentioned in policy?
Avatar
just the one in the policy, what isn't explicitly allowed is denied
12:22 PM
it's however better for most users to have only one bucket then create directories in it
12:23 PM
and if you need two buckets to separate pro vs perso for example, then maybe two accounts is better
Avatar
Morethanevil 8/2/2023 12:23 PM
Okay but this is okay One bucket fir one user You helped me more in an hour, than the docs the whole week 😁 I will write this to my wiki and make a Post on Lemmy and Reddit. I am surely not the only one steuggeling with this
12:23 PM
Thanks 🌞
Avatar
I found the docs rather helpful, but they're aimed at very technical and specific needs instead of being adapted for standard use cases, they aren't a tutorial
12:25 PM
you're welcome!
Avatar
Morethanevil 8/2/2023 12:44 PM
The standard cases would be most users, so a policy generator would be cool 😁
Avatar
Avatar
Xenthys
you're welcome!
Morethanevil 8/2/2023 12:45 PM
I will mention you in the postings if you like. Or you could post it yourself in the minio subreddit. Most people will then find it via search engines
Avatar
it's fine, I no longer contribute on Reddit because I can't really stand the platform nor its users anymore
12:46 PM
I'm no longer giving free content to Reddit, and I have better things to do than argue with redditors about my own use cases
Avatar
Morethanevil 8/2/2023 12:54 PM
Understandable I prefer Lemmy, I really love it by now 🥰
Avatar
Morethanevil 8/2/2023 10:32 PM
Just did a few things, I tried the policy and it works great, thanks again
10:32 PM
Next step was to write a "quick" tutorial for rclone with minio and s3drive
10:33 PM
@Tom Please review my guide and add it to your FAQ / Wiki / whatever. So users can see how it works. The guide is in my cryptpad here:
10:34 PM
You can use my screenshots too, they are not case sensetive, it was a vm
10:34 PM
10:35 PM
Nextcloud link will be available 3 days (automatic deletion)
Avatar
Avatar
Morethanevil
@Tom Please review my guide and add it to your FAQ / Wiki / whatever. So users can see how it works. The guide is in my cryptpad here:
That's great, thanks for your work. Before we're done with MkDocs, we could add that our Github and reference back from the website. In any case the required format would be MD. I don't really want to put any burden on you, but would it be possible for you to prepare it in the MD format? Please find the e.g. instruction that we have for Backblaze: https://github.com/s3drive/app/blob/master/INITIAL_SETUP.md and corresponding raw MD: https://raw.githubusercontent.com/s3drive/app/master/INITIAL_SETUP.md The images could be placed in the: https://github.com/s3drive/app/tree/master/resources/images perhaps it would make sense to create a specific folder for the instruction. If you're happy with that approach. please fork: https://github.com/s3drive/app and create the pull request to the repo.
Avatar
Avatar
Tom
That's great, thanks for your work. Before we're done with MkDocs, we could add that our Github and reference back from the website. In any case the required format would be MD. I don't really want to put any burden on you, but would it be possible for you to prepare it in the MD format? Please find the e.g. instruction that we have for Backblaze: https://github.com/s3drive/app/blob/master/INITIAL_SETUP.md and corresponding raw MD: https://raw.githubusercontent.com/s3drive/app/master/INITIAL_SETUP.md The images could be placed in the: https://github.com/s3drive/app/tree/master/resources/images perhaps it would make sense to create a specific folder for the instruction. If you're happy with that approach. please fork: https://github.com/s3drive/app and create the pull request to the repo.
Morethanevil 8/3/2023 7:01 AM
Okay I fork and add everything in there in MD. GitHub has a great preview and editor 😊
Avatar
Morethanevil 8/3/2023 7:49 AM
Pull request is done 🙂
Alex joined the server. 8/3/2023 9:33 AM
Avatar
Avatar
Morethanevil
Okay I fork and add everything in there in MD. GitHub has a great preview and editor 😊
Thanks for the article. I've moderated it a bit, fixed typos, casing, added some headings / warnings and then moved location within the repo: https://github.com/s3drive/app/commit/93c8b5dd5da32eb44e5b3143e5833962e376384b It landed here: https://github.com/s3drive/app/blob/master/RCLONE_SETUP.md
👍 1
Avatar
Morethanevil 8/3/2023 4:54 PM
Glad I could help a little bit. Typos etc were to be expected. I am not a native speaker 😅
Avatar
Avatar
Morethanevil
Glad I could help a little bit. Typos etc were to be expected. I am not a native speaker 😅
No worries, I am sure that native speakers make typos as well 😉
Avatar
Morethanevil 8/3/2023 4:57 PM
😁
Avatar
@Tom I was thinking about creating a green Contributor role, it isn't much but still a nice way to recognize individuals who go out of their way to help the project out, what do you think about it?
Avatar
Avatar
Xenthys
@Tom I was thinking about creating a green Contributor role, it isn't much but still a nice way to recognize individuals who go out of their way to help the project out, what do you think about it?
I like that. It seems that Github displays that if there is a pull request merged into repo, certainly we should have something like that on Discord. (edited)
Avatar
Good, I'll do that then
Avatar
Avatar
Xenthys
Good, I'll do that then
Feel free to add yourself then, you've helped already a lot ! 🙂
Avatar
Maybe later 😊
Avatar
Morethanevil 8/3/2023 6:37 PM
Issues don't count anymore 🫤 I read you need to have your profil public in your settings 🤔
Helios joined the server. 8/4/2023 11:49 AM
redsolver joined the server. 8/4/2023 12:19 PM
Avatar
Hi 👋
Avatar
Avatar
Helios
Click to see original message
5:23 PM
lol this thing
Avatar
Welcome, Helios, we hope you've brought sunshine (edited)
Avatar
Morethanevil 8/5/2023 5:15 AM
Sunshine would nice 🌞
5:15 AM
I found a little bug and opened an issue on GitHub ☺
Avatar
@Morethanevil Thanks, we will get to that next week. Backup module wasn't looked after for quite a while awaiting crucial changes in order to make background upload possible.
👍 1
Avatar
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Avatar
Avatar
Helios
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Hi @Helios, sorry that you face these issues, we use Stripe to handle the payments and don't have exactly full control over the card decline criteria. Since iDEAL is supported by Stripe I am going to have a look if that's something I can enable. In the meantime, all I can do is to ask you to try again or using different card. I've also PM'd you with a payment link which may help your transaction to pass through. Thanks !
Avatar
Avatar
Helios
I cannot subscribe to this, it tells me my card was declined... Would be nice to have other payment options like iDEAL or Paysafecard :/
Thank you for your suggestion, iDEAL is now enabled. If you have any troubles with the payment or S3Drive feel free to reach out to me directly. (edited)
Avatar
Avatar
Tom
Thank you for your suggestion, iDEAL is now enabled. If you have any troubles with the payment or S3Drive feel free to reach out to me directly. (edited)
Thanks!
Avatar
Hey @Tom any chance we will get S3Drive in Linux as a Flatpak?
Avatar
Avatar
Helios
Hey @Tom any chance we will get S3Drive in Linux as a Flatpak?
Yes, this is a work in progress (https://github.com/flathub/flathub/pull/4364), there were couple challenges that we've mostly solved and likely within couple next weeks it shall be live on Flathub.
👍 1
Avatar
Avatar
Helios
Hey @Tom any chance we will get S3Drive in Linux as a Flatpak?
In the meantime on top of: AppImage you can find deb package in the releases: https://github.com/s3drive/app/releases if that's any use for you.
👍 1
Avatar
Morethanevil 8/6/2023 6:54 PM
Tried the new update. Passwort-Manager works fine, thanks 🐱
6:54 PM
But this keeps popping up everytime I go back to the bucket 😁
6:55 PM
Hint: you already got 5 stars ☺
👍 1
7:01 PM
Tested autofill as you wished on GitHub, works as aspectedfor E2EE and adding profiles 👍
Avatar
Avatar
Morethanevil
Tested autofill as you wished on GitHub, works as aspectedfor E2EE and adding profiles 👍
That's great thank you for this suggestion. It's super helpful yet was super easy to build.
Avatar
Avatar
Morethanevil
But this keeps popping up everytime I go back to the bucket 😁
Does it go away if you click Maybe later or No thanks? We're not keen on integrating with Google APIs (privacy issues) in order fetch if comment was already added and improve this prompt experience, so basically this will bug user from time to time until: "No thanks" is clicked. I am going to check it again, perhaps there are some issues with the library that's supposed to decide when to show the dialog.
Avatar
Morethanevil 8/6/2023 7:16 PM
It does not matter which I choose As soon as I come back from the menu it shows up
Yibo joined the server. 8/7/2023 5:28 AM
5:29 AM
5:30 AM
怎么解决,不能安装
5:30 AM
打开文本文件的时候 要弹出的
Avatar
Avatar
Yibo
怎么解决,不能安装
Morethanevil 8/7/2023 6:05 AM
How do I fix it? It won't install.
Avatar
Avatar
Yibo
打开文本文件的时候 要弹出的
Morethanevil 8/7/2023 6:05 AM
When you open a text file, it's a pop-up.
6:06 AM
Translated with deepl
6:16 AM
i want open it using another app,but i can not
6:17 AM
it is oneplus 11
6:18 AM
when i using iphone, can open it with another app
Avatar
Avatar
Morethanevil
It does not matter which I choose As soon as I come back from the menu it shows up
This shall be now addressed with the most recent update.
Avatar
Morethanevil 8/7/2023 8:21 AM
Yes it is fixed now ☺
Great Scott joined the server. 8/7/2023 9:16 PM
FrenchToucan joined the server. 8/8/2023 2:59 PM
Avatar
@Tom problem with latest upgrade hanging.. happening pretty much constantly.. android version
Avatar
Avatar
Buzz69
@Tom problem with latest upgrade hanging.. happening pretty much constantly.. android version
Thanks for your feedback. Can you create #support item please? Can you describe how does it look like? On what screen this hanging happens? Does it get worse or get better after certain action? Do you have E2E enabled? Do you find anything interesting in Logs? We've deployed many smaller releases over the past two weeks https://s3drive.app/changelog Do you remember what was the last version that worked for you? What's your Android version and phone model?
test joined the server. 8/9/2023 8:56 AM
Avatar
Hello @test, what are we testing today?
Avatar
Your patience blobowoevil
Avatar
Will do!
Iron shinobi joined the server. 8/9/2023 11:47 AM
bingofps joined the server. 8/12/2023 3:04 PM
Ari joined the server. 8/13/2023 12:35 AM
Pjort joined the server. 8/13/2023 11:54 AM
InfiniteAds559 joined the server. 8/14/2023 10:04 PM
Avatar
InfiniteAds559 8/14/2023 10:13 PM
Hey fellas, I'm trying out the app using Storj as the back end. I have encryption enabled on my Android, but when I try to download my data on my desktop, the data downloaded in both photos and videos are empty. Edit: I plugged in the my encryption key on my desktop using the web app, and this is the error I'm getting: Error: FormatException: Invalid Key IV: [longnumber] Edit2: It looks like I'm still using the deprecated encryption. I plugged it in the other option, and now the files are showing up. Moreover, when using the web app, downloads always fail and awfully slow for a 2mb photo. With the app, it works as normal, but similar download speeds. Since I'm using a deprecated password, how would I go about updating it? Create a new password, and re-upload my files? (edited)
Avatar
Hi @InfiniteAds559, If you get: "Invalid Key IV" that indicates that you've objects encrypted using deprecated AES-GCM encryption scheme. S3Drive can open them, but you'll need to set up key using: AES-GCM key (deprecated) button whenever you want to access your files. This is because it needs to process your key using base64 encoding instead of plaintext (default for Rclone). In any case all existing AES-GCM encrypted data will remain readable, but whenever you update it or write new file it will use Rclone encryption scheme using your current key (whether a new plaintext or legacy base64). You don't need to re-upload your files, both schemes are supported and before we remove AES-GCM support we will give more than enough time. It is possible to use the AES-GCM password in Rclone CLI if you ever need. Given your AES-GCM password is: czNkcml2ZQ== using this command: echo "czNkcml2ZQ==" | base64 -d | rclone obscure - you can generate a password, e.g.: AQbZ5H8mrzlnkNj9MXnjpxS5QmxbRpw which can be used in Rclone config: rclone config file as indicated in this post: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 Speaking of decryption speeds in browser, let's continue in the support item that I've created: https://discord.com/channels/1069654792902815845/1140911911479808081 (edited)
Bryan joined the server. 8/15/2023 7:44 PM
ParadoxDude joined the server. 8/17/2023 7:14 AM
Avatar
Avatar
ParadoxDude
Click to see original message
Avatar
Welcome
dantheman61 joined the server. 8/17/2023 6:01 PM
mgrcentral joined the server. 8/19/2023 10:12 PM
Muntasim joined the server. 8/21/2023 7:54 PM
szirok joined the server. 8/23/2023 6:54 AM
Avatar
i have rclone encrypted files, file names and content, there is in config dump password1 and password2, i tried to set p1 and also p2 in s3 web drive, but it does not decrypt, why?
6:57 AM
so is it compatible with rclone e2e yes or no?
Avatar
Avatar
szirok
i have rclone encrypted files, file names and content, there is in config dump password1 and password2, i tried to set p1 and also p2 in s3 web drive, but it does not decrypt, why?
Please set up your Rclone as mentioned in this post: https://discord.com/channels/1069654792902815845/1069654792902815848/1135157727216279585 rclone password dump gives obscured password. You need to use your original text password. Alternatively you'll need to use "password reveal" on your obscured password. https://forum.rclone.org/t/how-to-retrieve-a-crypt-password-from-a-config-file/20051 We're not supporting Rclone 2nd password, but it's part of our roadmap: https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password We're supporting default Rclone salt: https://forum.rclone.org/t/how-to-correctly-setup-the-salt-for-the-crypt-remote/4273/2 I've created additional two roadmap items to support your use case: https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt https://s3drive.canny.io/feature-requests/p/add-option-to-restore-rclone-password Please vote on them, so the priority is pushed higher. If you have any more issues with S3Drive, please create a support item: https://discord.com/channels/1069654792902815845/1102236355645419550 Thanks (edited)
Avatar
Avatar
szirok
so is it compatible with rclone e2e yes or no?
It is entirely compatible, but we're not yet supporting 2nd password. You need to set up S3Drive and Rclone using just one password.
Avatar
Avatar
szirok
Click to see original message
8:27 PM
I was trying to create a support post but, I am unable to
8:28 PM
To report a bug
8:28 PM
In app
Avatar
Hi all, is there a place for low priority feature requests 😄 I have got one
Avatar
Avatar
Ari
Hi all, is there a place for low priority feature requests 😄 I have got one
Hi, you can request them in #support, there's a tag for that, don't worry about priorities yet since this community isn't very active at the moment
👍 1
yossie joined the server. 8/26/2023 6:07 AM
Cold Fusion joined the server. 8/26/2023 11:49 PM
𝖠𝗆𝗈𝗌 joined the server. 8/27/2023 11:29 AM
Avatar
please add support to download using save file as, not into browser storage. Lets say on c: drive i have 1gb free space, so i want to save 5gb file on e: drive where i have 200gb free space. i cant because web app downloads to cache on c
7:48 AM
please add possibility to download using save file as at start, not first to cache
zigFort joined the server. 9/1/2023 6:34 PM
Avatar
Avatar
zigFort
Click to see original message
Avatar
Hi, welcome!
Cody joined the server. 9/4/2023 9:22 AM
WhyIsTheRumGone joined the server. 9/4/2023 11:43 AM
Avatar
Avatar
WhyIsTheRumGone
Click to see original message
WhyIsTheRumGone 9/4/2023 11:43 AM
Avatar
WhyIsTheRumGone 9/4/2023 12:01 PM
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Avatar
Avatar
WhyIsTheRumGone
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Hi @WhyIsTheRumGone , Our billing integration with Stripe doesn't yet support trial, but you can test all app's capabilities by creating a free account (https://s3drive.app/account) and use the free 10GB allocated storage plan, as long as you login to S3Drive app with the same credentials. Behind the scenes there is an S3 cluster that we manage. Pro version allows you to use all these features but with your custom S3 endpoint. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 1:52 PM
Gotcha thank you i will try trhat out
1:53 PM
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
Avatar
Avatar
WhyIsTheRumGone
Hey @Tom , I would like to buy the pro version since I want the mounted drive option. But I've had less than sub par experiences with other mount drive applications, which is how I landed up with yours. Is there a way to get like a 7 day trial to test the mounted drive option to see if it is worth it?
Behind the scenes we're using: https://rclone.org/commands/rclone_mount/, so if that option works for you, S3Drive works pretty much the same, except it's "clickable" from the app. You can also use Rclone mount yourself outside S3Drive, but the data (including encrypted data) will stay compatible between S3Drive and Rclone. (edited)
🤟 1
Avatar
Avatar
WhyIsTheRumGone
Also, follow up. I know the app is not open source, but do you all have a contribers system where other devs can help fix issues / add features?
For this to work the app doesn't need to be FOSS, but at least source open. Whilst we've had that in mind it doesn't fit with our current revenue stream. We don't have enough capacity to properly manage open-source community and at this stage we think that having full control on the project direction allows us to focus on deliverables, build lean and deploy fast. With open-source we would likely receive dozens of pull requests for features which are not part of the streamline, yet we would have to dedicate resources to maintain, test, fix, refactor etc. As long as we get enough revenue from selling data plans (due to be released Q4 - https://s3drive.app/pricing - monthly/yearly), and not the software itself, we could then think of making clients open source: https://s3drive.app/faq?q=opensource as both sides may benefit from this move. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 2:06 PM
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Avatar
Avatar
WhyIsTheRumGone
gotcha that makes a lot of sense. So for now it's feature requests and github issues that will push the development forward from our side? Is there a tiered system such as if you have x license we prioritize your issues etc?
Mostly yes. We don't have any formal decision process on this. If something gets added by the community we then prioritize internally based on multiple factors, general interest, development time etc. For bigger number of licenses and very custom features (not part of the general roadmap) we have an Enterprise plan - https://s3drive.app/pricing where we can provide quotes on custom features/integrations and discounts. Do you have anything in mind in terms of features / bugs? We can discuss this here or via different channels. (edited)
Avatar
WhyIsTheRumGone 9/4/2023 2:21 PM
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are:
  • When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
2:22 PM
  • File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
Avatar
Avatar
WhyIsTheRumGone
Gotcha. Yeah this is not on an enterprise level altough I work with large companies who might benefit from this app. I am gonna test it and if it works well I might recommend it to our project teams. We currently use Gladinet which works fine but your client(s) seem so much smoother etc. As for features and bugs, I like identifying possible new features and bugs especially if I like the app so if I can communicate them here that would be cool. Just started using this today but the things I have for now are:
  • When you close the desktop client, in windows, it should auto minimize to tray to ensure sync jobs keep on running. Right now, I go in, change stuff or look for a file and then when I hit the X it closes the whole app.
We've got that one internally, but created public roadmap item: https://s3drive.canny.io/feature-requests/p/desktop-app-minimize-to-tray-dont-close At the moment you can use tray icon and "Hide" option or simply minimize the app. It's a small item, but then the actual solution given our tech / cross-platform wasn't entirely easy we haven't implemented it straight away.
🤟 1
Avatar
Avatar
WhyIsTheRumGone
  • File offloading / Cloudnas. If we could add a feature where files in a targeted folder will be checked for last modified etc and if it hasn't been modified in x days (whatever user specifies) it is removed from the local machine but still stays in the s3 bucket. Kinda how onedrive / wasabi cloud nas does it
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
jguzmansulb joined the server. 9/4/2023 2:31 PM
Avatar
Avatar
Tom
That's interesting. I've added an item: https://s3drive.canny.io/feature-requests/p/file-offloading-cloudnas-delete-idle-files-locally Do you have some additional docs about the behavior / use-cases?
WhyIsTheRumGone 9/4/2023 2:58 PM
Yeah this is a game changer. If wasabi wasn't so damn expensive with this tech it would be paid for already. This explains it well :https://www.siscloudservices.com/storage/content/our-services/data-center-on-cloud/wasabi/20230117-sis-wasabi-cloud-nas-data-sheet.pdf
2:59 PM
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
3:00 PM
But with this cloudnas you can basically house like 8TB of storage on a 500GB drive .Which is what we are doing at some clients
Avatar
Avatar
WhyIsTheRumGone
It basically leaves behind a tiny little file that seems to be the actual file and when you try to access it, wasabi quickly downloads it from the bukcet to the location it is supposed to be in and then it works. But I mean even if you forego that feature, the automatic offloading of cold data is such a massive help
Quick question. Do you install Wasabi Cloud NAS on the end computer or on a local server and then share this via network mount within the organisation?
Avatar
WhyIsTheRumGone 9/4/2023 3:36 PM
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Avatar
Avatar
WhyIsTheRumGone
So you can do both. But what we've done is install it on a file server. point it to a secondary drive, say G:. Then we share folders in that drive using SMB like normal. Wasabi obfuscates the offloading process using these stub files so from the consumers of the SMB shares, they know no difference but then on the file server, wasabi cloud nas offloads the cold storage. Lemme know if that answered the question lol
Got it. I am trying to understand what's possible what's not. We're currently running FUSE mount which basically gives you access to unlimited cloud NAS (S3 based). There is also VFS cache which could be tweaked to emulate "hot storage onloading", which would be the other way round from what you describe. The file that you've accessed recently would end up stored in a local cache, so next time when you access it, it's read from the local cache directly (no latency). The challenge with "cold storage offloading" is that this feature must be closely integrated with the native file system and since S3Drive is supposed to run on multiple OS's (and not all FS's would support this), that means we would have to make this feature e.g. Windows only or "move it away" (exactly the same way the Wasabi Cloud NAS does that) to separate software (probably would have to be Windows, due to NTFS support of https://learn.microsoft.com/en-us/windows-hardware/drivers/ifs/about-file-system-filter-drivers which I don't think it's possible on Linux and Mac) which would then have to be network mounted. The somewhat convoluted alternative would be to use FUSE mount as it is now, but providing custom cache implementation which would either read file from a local file system or cloud/S3 (depending on the availability). The S3Drive would also take care of cleaning up idle / cold data from the local FS based on some settings (e.g. 90 days). From a user point of view they would see hot files only in their local FS location and "all files" in the FUSE mounted location. They would have to be instructed to actually not use the local FS, but the FUSE mount instead. This would work on Windows, macOS and Linux. I am not sure how feasible is to share FUSE mount via SMB, I know that whilst technically possible, there are some challenges. Alternatively each user could work with their local FUSE mount, but any changes could be synced online via AMQ or other queue/notify mechanism) (edited)
Avatar
WhyIsTheRumGone 9/4/2023 4:46 PM
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
It's not as fancy as you say, but would be good start towards more advanced solutions and if SMB FUSE sharing works then from a user point of view they wouldn't see any difference, since the heavy lifting (in a slightly different way than Wasabi Cloud NAS) would be done by the S3Drive instance running on some Windows Server node. EDIT: It seems Rclone FUSE SMB sharing indeed works: https://forum.rclone.org/t/solved-is-it-possible-to-access-my-rclone-mount-as-a-samba-share/18335/6 (edited)
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
I can also see that it's not even about: "last modified", but more about: "last accessed".
Avatar
Avatar
WhyIsTheRumGone
Yeah not sure about the techincality on this implementation. As you said the cross platform is a major issue as it will see compatibility issues. So with the current sync options , might be able to create one that does the normal sync such as to rmeote etc, but then add some extra params such as if the file has not been touched in 90 days we will sync it up and remove it from the local FS. This is not as fancy as the wasabi bottomless NAS idea but atleast it will reclaim space on machines where file space is limited
When user adds a new file what should happen? Should it be automatically synced to Wasabi or should stay storred locally and only be synced to Wasabi when cold? (edited)
Avatar
WhyIsTheRumGone 9/4/2023 5:37 PM
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Avatar
@Tom did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
Avatar
Avatar
WhyIsTheRumGone
Wasabi you can adjust it but by default I think it should sync it to wasabi so a backup is made and then when it goes cold it should be offloaded from local storage to clear space
Great, I've modified this card to reflect what we've discussed and what I've researched so far: https://s3drive.canny.io/feature-requests/p/file-offloading-cloud-nas-move-idle-files-to-cloud Can't give any exact ETA, but we will get to this.
Avatar
Avatar
Buzz69
@Tom did you use go daddy or similar for setting up your website? i'm looking at a similar format / log in account / payment.
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
Avatar
Avatar
Tom
It's a NextJS based layout, payments and login use some ready libraries, but had to be heavily customized. I am not sure what GoDaddy offers, but if you have some "off-the-shelf" definitely go for it. (edited)
great, thanks
5:52 PM
i think there are quite a few, ready to go but its somewhat undefined what it can do.. i'll do more research!
pogox joined the server. 9/6/2023 10:36 AM
Avatar
@tom Hi Tom, do you have a png or similar of your logo we can link from our website? (edited)
MaloBoi joined the server. 9/9/2023 12:39 PM
Avatar
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
Avatar
Avatar
Buzz69
@tom I've got a Pro Standalone account on my profiles - is that backup going onto backblaze and i'm assuming it is limited to 10GB?
With Pro Standalone you can manage multiple profiles and configure them separately, but backup will work on currently selected one. There is a feature request to support multiple accounts operation: https://s3drive.canny.io/feature-requests/p/support-using-multiple-accounts-at-once As far I am concerned Backblaze offers free 10GB account: https://www.backblaze.com/cloud-storage/pricing They're in the middle of the pricing changes which if I understand will make the free account even better (more egress): https://www.backblaze.com/blog/2023-product-announcement/ You don't need Pro Standalone to use external Backblaze account or backup as such. You can also use free 10GB account that we manage. You don't need Pro Standalone to use the advanced features on account managed by us, we provide them together in one package. I hope this helps to understand our offering.
Avatar
ok to be honest I just signed up to support the project without thinking too much about the user case. I guess I can see why it would be useful to have multiple backup accounts on different providers for belt and braces security - ie your precious data backed up in more than one place. I would be interested in the use case that was originally intended for this feature?
gm1k joined the server. 9/10/2023 8:52 PM
jef joined the server. 9/10/2023 10:03 PM
jef joined the server. 9/10/2023 10:06 PM
10:06 PM
hey @Buzz69
10:07 PM
@Tom just upgraded and i think this app is very useful
STEPHEN joined the server. 9/10/2023 10:10 PM
Avatar
Avatar
STEPHEN
Click to see original message
Avatar
Good afternoon good folks
10:11 PM
Hullo jefffj
10:11 PM
I'm having issue with my albums showing under the media backup tab
10:11 PM
Any tips?
10:11 PM
10:13 PM
But, they're their
10:13 PM
There
Avatar
try making a support ticket? #support
Avatar
... there's 8 of us
Avatar
Plus I didn't see
Avatar
yeah i meant maybe someone will see it there and help
t_rott joined the server. 9/10/2023 10:23 PM
Avatar
Yo great proj
Avatar
Avatar
t_rott
Click to see original message
gord joined the server. 9/10/2023 10:40 PM
Avatar
Avatar
gord
Click to see original message
Avatar
Avatar
gord
Click to see original message
Sticker
Jeffrey W Pearson joined the server. 9/11/2023 12:01 AM
Avatar
Avatar
gord
Click to see original message
Avatar
Avatar
Jeffrey W Pearson
Click to see original message
👍 1
Avatar
Avatar
t_rott
Click to see original message
Avatar
Avatar
STEPHEN
Click to see original message
Sticker
Avatar
Scprime boys blowing it up in here 😂
Avatar
it reads like @Tom uses an S3 cloud storage platform for hosted S3Drive accounts
2:22 AM
Prob should peek at XNS
2:28 AM
I'm using S3Drive on my selfhosted relayer, works perfect
Avatar
Just set the fam up for iPhone backups. Using xns.tech for relayer with minio. Working perfect. 🤘
👍 1
Avatar
yeah same did you get the paid version
2:41 AM
big spender
Avatar
tom's getting paid todsay
2:41 AM
ha
Avatar
It’s priced very well
Avatar
yeah its great
2:42 AM
sent like 7k photos from my phone. impressed how it wirked
Avatar
Yah getting there my self. House pipe slow upload. Need to go over to colo and warp speed 😂
Avatar
hi guys, glad you made it here, @jef already mentioned XNS to Tom 😎
👍 2
Avatar
Avatar
jef
sent like 7k photos from my phone. impressed how it wirked
yeah, really works well on xns.. and xns performs better than backblaze too
💪 1
Avatar
Backblaze is annoying.. Installed it for a comparison a while back
2:10 PM
Too many pop ups
Avatar
Would be great to get XNS added to the list of officially supported clouds for S3Drive
Avatar
I second that
Avatar
Still uploading. Oofff lots of phone backups. 30GB so far and two more phones to go. 😂😎
Avatar
ya. I use S3Drive with XNS as well. backed up all me photos.
4:23 PM
background proccesses will be nice but my 60GB will be done by then
Avatar
Hi, I believe you all come from another community that's around XNS, thanks for passing by!
Avatar
hey yeah we did! we are running XNS cloud relayers and using S3Drive with them
4:24 PM
works really great
4:24 PM
keeps the data backed up and very secure
4:25 PM
and affordable
Avatar
I mean, as should any S3-compatible provider behave :p
Avatar
you'd hope so!
4:26 PM
$7/tb, pay as you go, no expensive egress and all E2E encrypted
Avatar
are you from the XNS marketing department?
Avatar
im a licensed reseller 😉
4:27 PM
and an angel investor
Avatar
ah, explains you want to spread the word
Avatar
we're speading your word too
4:28 PM
telling our users to try S3Drive
Avatar
that's cool, however I'm afraid S3Drive is unable to promote any specific provider, we want to remain a pure S3 implementation and not recommend anything in particular
Avatar
i believe @Buzz69 is writing up a tutorial
Avatar
tutorials are fine, however general conversations shouldn't diss any provider, and your affiliation should definitely be disclosed
Avatar
thats totally fair and im happy to disclose
liquidbread joined the server. 9/11/2023 4:32 PM
Avatar
Avatar
jef
$7/tb, pay as you go, no expensive egress and all E2E encrypted
please do whenever you send a message like that, most people here are users and not providers or affiliated to them, so we expect feedback to be from other standard users by default 😉
Avatar
Oh hai
4:33 PM
haven't been green leaf in awhile
Avatar
thats fair. i was more speaking to you directly about those features tho
4:34 PM
a bunch of us liked your app, and we saw you have a discord so we joined in
Avatar
yeah, no problem, I'm able to ask as well, I'm saying just in case since this community is slowly growing
👍 1
Avatar
but we'll be community minded
4:35 PM
a cool idea might be letting users select roles based on their clouds? maybe giving app to cloud support if needed
Just_Mike joined the server. 9/11/2023 4:37 PM
Avatar
Avatar
Xenthys
that's cool, however I'm afraid S3Drive is unable to promote any specific provider, we want to remain a pure S3 implementation and not recommend anything in particular
so i when i installed I saw this message
4:40 PM
Support for AWS S3, Backblaze, Wasabi, Scaleway, Storj, MinIO and any other S3 compatible provider. Sign-up for a free account, no credit card required.Aug 22, 2023 S3Drive: Cloud storage on the App Store - Apple
4:40 PM
So thats what I meant would be cool to get XNS added to
4:41 PM
less a promo, and more simply recognized
Avatar
I'll be honest, even Scaleway and Storj are a stretch so we should probably shorten this by only mentioning the major players that definitely don't need any recognition
4:45 PM
You certainly know or can at least guess the challenges of publishing an app, where keywords matter and only what we believe will be searched will figure
4:47 PM
i just saw that list of apps, esp including stroj (since XNS is distributed and blockchain) and wanted to ask about inclusion
4:47 PM
but i think we're here to USE this app not just shill
Avatar
which is understadable, asking is always a good idea
Avatar
i paid for pro and a lots of these guys did or will too i think (edited)
4:47 PM
so we're gonna use it lots
Avatar
I did too, I'm talking in the name of S3Drive for this specific matter but I'm not a developer myself
Avatar
i appreciate your honest convo too.
Avatar
Avatar
jef
i paid for pro and a lots of these guys did or will too i think (edited)
Yup, will most likely be using this within the week
Avatar
full disclosure, I worked a few years for Scaleway, I already left when I discovered S3Drive… and I believe it should be removed from the list doggokek
4:49 PM
Storj's free tier was heavily reduced, so they're probably going to be removed too
Avatar
Avatar
Xenthys
full disclosure, I worked a few years for Scaleway, I already left when I discovered S3Drive… and I believe it should be removed from the list doggokek
That's confirmed. We're removing Storj and Scaleway.
4:51 PM
yeah i was asking to be added to a list if that list was growing, but if its being pared, then totally understand
4:52 PM
sincere QQ - what do you charge for hosted cloud service?
4:52 PM
(and i think i really misread that business model)
Avatar
As this grows I think a channel for wish list functionality would be good. I have a few items that I think would be good for the mobile app. I don’t want to clog gen pop up with them though.
Avatar
Avatar
jef
(and i think i really misread that business model)
nm thats on the main site lol
Avatar
Avatar
t_rott
As this grows I think a channel for wish list functionality would be good. I have a few items that I think would be good for the mobile app. I don’t want to clog gen pop up with them though.
Avatar
Ok thank you. Perfect.
4:55 PM
Excited to see this move forward
Avatar
yeah bucket auto discovery would be great for self hosted
Avatar
as a self-hosted MinIO user, I'm not against it :p
4:56 PM
especially for path-style URLs, where buckets behave more like root-level directories
Avatar
yeah, modern IAM gives admin privs to keys but setting up multiple profiles is a PITA
4:58 PM
anyways, here for the growth!
Avatar
$S3D to the moon… wait
4:58 PM
wen pancake swap SECRET_KEY
Avatar
aws s3 cp wallet.dat boket:/sekrit
Avatar
for real now, if you want to try this, I can hook you up with credits
5:00 PM
just for knowledge
Avatar
maybe one day, but I don't have much free time to allocate for testing at the moment
5:01 PM
im stuck at home on my weekened with covid so too much free time lol
Avatar
I have 12 TB (replicated) with my MinIO server, I paid like $700 for the hardware, it's way cheaper for me as a sysadmin to self-host
Avatar
yeah but whats your 3-2-1- backup solution ;P (edited)
5:03 PM
duh (edited)
Avatar
4x4 TB in RAID 5 so 12 TB usable, the whole volume has a daily backup to cold storage priced at around 2€/TB/month, and that 12 TB volume is only a copy when I talk about important data
5:05 PM
if I lose my memes, eh, I just have to scroll my DMs with friend lol
Avatar
haha yeah
5:07 PM
we're def more SMB/Enterprise looking. Sincerly plan on suggesting your app to all my clients. I'm US based and talk a lot about data control. Getting their backups off Apple/Meta/ Etc
5:07 PM
Phone app especially for these users
Avatar
Avatar
Xenthys
4x4 TB in RAID 5 so 12 TB usable, the whole volume has a daily backup to cold storage priced at around 2€/TB/month, and that 12 TB volume is only a copy when I talk about important data
I know some that use Glacier Deep Archive, that's $0.00099 per GB. You don't really want to lose your data as if you add the restoration costs and bandwidth it gets pretty expensive... but well if you lose some data then you might well decide to drop it or suck the costs.
Avatar
yeah i saw a quote about two kinds of people. Those who havent lost data and those who backup properly
Avatar
For me it's worth it as long as I don't restore my data more than once a year… which is alright, if my NAS dies once a year I'm replacing it because it's definitely not a good one
Avatar
Avatar
jef
yeah i saw a quote about two kinds of people. Those who havent lost data and those who backup properly
see, that's where I'm smart and belong to the third kind: I lost someone else's data doggokek
5:11 PM
in my defense, I was a kid and accidently dropped my mom's external hard drive
Currypaul joined the server. 9/12/2023 3:49 PM
eelee joined the server. 9/12/2023 7:25 PM
Avatar
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
Avatar
Avatar
eelee
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
you can also use your own S3 buckets. S3Drive works really slick that way.
👍 1
Avatar
Avatar
eelee
I wanted to try the system, but what was putting me off when i see a page that doesnt have any company address, name or identification in which country it operates. Many people would not trust with their data or skip it due to fear of scam. Friendly advice would be that you place transparent info about the team, where is the company based and where are the servers positioned.
That's entirely fair point. You can find our current business address at the relevant places where you can get the software, that is App Store, Google Play and Microsoft Store. We're providing software (for you to use with your S3 account), but we're not providing the service just yet (except technical preview of free 10GB account). We're in the process of changing our operational model and switching the company type to something which is compatible with providing privacy friendly SaaS that's also responsible for keeping customers data safe. This is actually one of the things that's blocking us from providing paid managed account. We're working heavily on tech, but also exploring different laws and jurisdictions to make conscious decision compatible with what we do, but also where we live. Just to give you an idea, registering a business (limited company) + director service and virtual address takes couple hours to couple days, anyone could do that and present that on their website straight away. We're going little bit different route. You can expect more information about our new company, operational model etc. around Q2 2024. Stay tuned. (edited)
👍 5
Xenthys pinned a message to this channel. 9/12/2023 9:02 PM
Avatar
Thanks for that great info Tom.
Avatar
ya good info
Avatar
@Tom are you going to build your own data center?
Avatar
that requires a lot of money and people to take care of it, not the plan afaik
Avatar
Yeah I assumed!
10:23 PM
So the plan is to resell?
Avatar
like the current trial is based on Backblaze, that seems to be the most sensible solution nowadays
Avatar
What if I could get you $4.99/tb pay as you go. No added fees?
10:28 PM
Not trying to shill at all. Trying to work together on the same thing
10:30 PM
That's not customer price. I'll talk to founder if you're interested in being a reseller
10:35 PM
We give 2x free egress too
Avatar
Yay 3x free egress coming to B2 in October
Avatar
Large file downloads get stuck at processing for some reason
2:40 AM
Shared links
Avatar
Avatar
zer0
Yay 3x free egress coming to B2 in October
Avatar
we have free egress at home doggokek
Avatar
Avatar
jef
What if I could get you $4.99/tb pay as you go. No added fees?
I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)
10:25 AM
The sorting is random for some reason
Avatar
Avatar
zer0
The sorting is random for some reason
Is it Backblaze or some other provider?
Avatar
Backblaze
Avatar
Avatar
Tom
I'll be honest with you. It's unlikely we would make any provider change at this stage. Our APIs / auth are already integrated closely and it's a cost/time/risk for us to make such change. We've been exploring this for quite a while and decided that we'll stick to reasonably priced, but reputable one. Before I worked for S3Drive, I've been using Backblaze as a dev for many years. Naturally I've suggested it for S3Drive. How much we pay for data is one thing... but the consequences when provider loses people's data is the other thing. Cheapest was iDrive (https://app.idrivee2.com/signup-reseller), comes out at $1.5/TB, can you beat it? We're not interested in being a reseller at all, however if you are interested to resell S3Drive under your brand and your storage we can handle this via Enterprise package (https://s3drive.app/pricing). We've got different tiers and billing modes (per user or percentage fee). If you're interested, please drop us an e-mail at: sales@s3drive.app, and include some details: Do you have an idea how S3 credentials would be managed? How users register on your website, is it e-mail/password or other forms of auth? Do you expect S3Drive to be integrated tightly with your auth system? Alternatively do you provide some means of credentials export (e.g. a formatted text, QR code, exported file etc.) that we could seamlessly import into S3Drive? How would you like to manage software releases and software updates? Do you have accounts on App Store / Google Play and are you comfortable managing them? We would then be able to come back to you and give you some rates. Thanks ! (edited)
thanks for all this, i saw your whitelabel offer and its def in the back of my mind. But i'm working mostly on SME and trying to leverage them off hypercloud. BUT i will be referring them to all use your app.
Avatar
Avatar
zer0
The sorting is random for some reason
One question is it the order when you fetch the existing results from Backblaze or just after the upload? When you refresh, is it consistently "broken" or always random? (edited)
Avatar
Screenshot taken now. Uploaded yesterday
👍 1
8:03 PM
Seems consistent
Avatar
Avatar
zer0
Screenshot taken now. Uploaded yesterday
Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.
Avatar
Avatar
Tom
Thanks for reporting. There is indeed issue related to folders. We will have that addressed. Does issue apply to already uploaded files? In a previous screenshot you've posted some files, but can I assume it's just view straight after upload? Regardless, we'll try to fix the order of uploaded files as well.
I'd say around 5 mins after upload
9:09 PM
Wait I'll open the same directory now
9:10 PM
Yea same
9:11 PM
Oh I do have to mention they were uploaded with rclone
Avatar
Avatar
zer0
Oh I do have to mention they were uploaded with rclone
Ah, fair enough. As such we're not ordering results coming from S3. Since files with encrypted filename have original filepaths encrypted their order isn't actuall inline with the expected after decryption. This will have to wait until this gets implemented: https://s3drive.canny.io/feature-requests/p/implement-order-by-name-size-modified Thanks for the heads up, I wasn't aware of this myself.
Avatar
Avatar
zer0
Screenshot taken now. Uploaded yesterday
The folder order will get fixed in a next release.
👍 1
Avatar
Avatar
zer0
I'd say around 5 mins after upload
Improvements were released to Android, I would appreciate if you could check folder order (as well as Rclone uploaded file order), it should work now. Other platforms will receive this update over the next few days. If you have any more issues or would like to add a feature request please use #support, so we don't clutter up this channel.
brizio joined the server. 9/14/2023 12:53 PM
Avatar
Nice I'll try
brizio joined the server. 9/14/2023 4:32 PM
Avatar
Is there a process for Android updates? I don't see an update in the play store
Avatar
just log onto play store Jef, S3drive also provides prompt if you need to update..
CubityFirst joined the server. 9/15/2023 12:06 PM
Avatar
Welcome Cubity
snoo_Wave 1
jggcvghhhh joined the server. 9/17/2023 1:21 AM
EmiIia joined the server. 9/19/2023 4:30 PM
Avatar
Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.
Avatar
I believe it is a work in progress
Avatar
Avatar
Xenthys
I believe it is a work in progress
Any ETA?
Avatar
Only Tom would be able to answer, I can't guarantee anything at my level
Paper joined the server. 9/20/2023 1:50 AM
Avatar
Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!
1:52 AM
I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)
Avatar
Avatar
EmiIia
Deal breaker is no background backup solution for the app. Meaning, you gotta stay in the app while the app does a backup of everything.
It is high on our priorities list, however we've ran out of allocated time to implement it properly on both iOS/Android (very different approaches) and switched to other important features. We'll be revisiting this topic again. Realistically this is something we will address in Q1 2024, however there is a small we will have it ready before Christmas.
Avatar
Avatar
Paper
Hey all! Just found this project by searching "rclone" on Mac's App Store, a very interesting surprise!
That's interesting. Search results positioning on App Store is always bit of a magic to me. BTW. We release S3Drive on Mac App Store with some delay, so if you want to be always up to date please use the signed AppImage: https://s3drive.app/desktop
Avatar
I’ll wait with buying enterprise for my company company then. (edited)
Avatar
Avatar
EmiIia
I’ll wait with buying enterprise for my company company then. (edited)
If you have any specific questions/needs regarding enterprise please drop us an e-mail leaving some info about your use case. It's an entirely different product with its own set of priorities.
Avatar
Avatar
Paper
I'm interested to know how are photo thumbnails stored, is a thumbnail cache stored in S3? Or is it local only and therefore requires downloading all photos beforehand? (edited)
We load full file version and keep it in a local thumbnail cache. Yes it does require downloading all photos beforehand. In our legacy photo backup product, we've been generating thumbnails the moment when photos were backed up. We plan to implement this feature. Since S3Drive supports also existing file systems we would have to implement a process to generate thumbnails for existing resources, this would require fetching full image locally anyway (I mean we could offload to the back-end, but this would go against the E2E encrypted privacy model), so we haven't rushed this. (edited)
ajon joined the server. 9/20/2023 2:16 PM
Avatar
Avatar
ajon
Click to see original message
Sticker
👋 1
Avatar
when will auto backup system enable in s3 drive android app?
Avatar
Avatar
ShovoN
when will auto backup system enable in s3 drive android app?
What backup do you have in mind? Currently we can backup your albums as soon as you configure/select them. Backup needs app to be "open running" before we get to the background mode: https://s3drive.canny.io/feature-requests/p/background-media-backup
👍 1
OQTRIAD joined the server. 9/21/2023 12:47 PM
Mic joined the server. 9/21/2023 6:11 PM
Avatar
Morethanevil 9/21/2023 6:43 PM
Made a post about this on Mastodon ☺
👍 1
Avatar
very nice!
Avatar
InfiniteAds559 9/22/2023 6:18 PM
@Tom I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result
Avatar
Avatar
InfiniteAds559
@Tom I'm trying to update the app (MacOS), but it keeps telling me I have an outdated version. I downloaded the app through the website multiple times now, but still the same result
We've just updated macOS builds to the newest 1.5.3 - https://s3drive.app/changelog Please try now install newest DMG from our website. It should resolve your issues. What message did you get exactly from the app? Was it update more recent version available or perhaps that your version has expired? (edited)
Pedro joined the server. 9/22/2023 7:49 PM
Avatar
Avatar
Pedro
Click to see original message
Sticker
Avatar
I really love your product!! That was definitely missing…. Simple, rclone, cross platform
👍 1
ruhascalin joined the server. 9/23/2023 5:17 PM
Mondo Magic joined the server. 9/25/2023 10:27 AM
Avatar
Avatar
jggcvghhhh
I really love your product!! That was definitely missing…. Simple, rclone, cross platform
Thank you for these words. Please consider leaving us a review on App Store / Google Play and spread the words about the app. It really help us ! (edited)
👍 1
Avatar
Why do I see the error "Bucket quota exceeded"?
Avatar
Avatar
Mondo Magic
Why do I see the error "Bucket quota exceeded"?
Hi ! It's likely that you've exceeded the allocated storage. Bear in mind that by default all accounts have enabled versioning, so even if you delete file it counts towards quota until you do the hard delete or delete all file versions. Can you go to the left drawer and refresh the storage statistics?
Avatar
I see 14.88 GB of 12 GB used 10.35 GB of current data 4.54 GB of versions
4:14 PM
So the storage it's not unlimited?
4:16 PM
Now I have deleted the trash and it's 11.16 GB of 12 GB used 10.35 GB of current data 836.14 MB of versions
Avatar
Avatar
Mondo Magic
So the storage it's not unlimited?
Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)
Avatar
Avatar
Tom
Right, so you've managed to clean up things a little bit. Pardon my question, but where did you get this information that the storage is unlimited? (edited)
I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)
Avatar
Avatar
Mondo Magic
I was searching on Google Play unlimited cloud storage and it gave me the result S3Drive app (edited)
Fair enough, we don't offer unlimited storage and don't use that keyword anywhere, however using S3Drive you can connect to any S3 compatible back-end. This in principle gives you unlimited storage... but it doesn't necessarily imply free.
Avatar
Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)
Avatar
Morethanevil 9/26/2023 1:36 PM
A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup 🤔 Now I have duplicates, but I can easily remove them This is only a cosmetic bug
Avatar
Avatar
Morethanevil
A small bug for importing all buckets from an endpoint: I already setup some buckets and they were imported again . Maybe the import should skip those buckets, which are already setup 🤔 Now I have duplicates, but I can easily remove them This is only a cosmetic bug
I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.
Avatar
Avatar
Paper
Is rclone used behind the hood? Would it be easy to support Webdav in addition to S3? Just curious (edited)
I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog
Avatar
Avatar
Tom
I am not sure what version are you using, but it's been added in 1.5.1 already: https://s3drive.app/changelog
Not Webdav server, webdav client
Avatar
Avatar
Paper
Not Webdav server, webdav client
I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?
Avatar
Avatar
Tom
I see, well, for now we are fixated on S3, we have plans of supporting different back-ends though (https://s3drive.canny.io/feature-requests/p/add-support-for-google-drive-and-onedrive). There is some bigger internal work required to abstract S3 away. Once we have it done, we would then be able to implement any back-end relatively easy. Unfortunately that's not something we will be able to implement this year. Out of curiosity, do you mind sharing what's your use case? Where are you trying to connect?
Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)
Avatar
Avatar
Paper
Oh, it's just Hetzner Storage Share, not a big deal (not Storage Box, which I believe it's lower performance) (edited)
I am not aware of performance differences between these two, but probably the only supported way so far would be to set up CIFS mount to Storage Box (or the other one) and then expose it using S3 via MinIO, Garage, SeaweedFS or anything alike. (edited)
👍 1
Avatar
Morethanevil 9/26/2023 5:58 PM
I used storageboxes before I switched to my own VPS with MinIO. The performance is awesome and the prices are very good, but limited functions.
Avatar
Avatar
Tom
I assume that you've had the encryption keys set up for buckets that were duplicated? Currently new buckets are "merged in", but configuration item with encryption and without encryption key is treated separately. We should probably skip them, instead of creating duplicating entries. Going make a note.
Morethanevil 9/26/2023 5:59 PM
Yes the ones with encryption were doubled.
TrkDemon joined the server. 9/28/2023 11:40 AM
Avatar
Avatar
TrkDemon
Click to see original message
micahflee joined the server. 9/30/2023 10:45 PM
Avatar
Hi @TrkDemon !
11:23 AM
Hello @micahflee !
*SnowLLM-69B joined the server. 10/3/2023 11:58 AM
barrrrtek joined the server. 10/5/2023 4:57 PM
Avatar
A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)
Avatar
Avatar
jggcvghhhh
A feature request... I try to accomplish the following scenario: store data at home on my own SBC and rclone to my s3 account. Use s3drive to access the files from remote. This serves as a backup and easy possibility for remote access without opening my firewall (or use a VPN). I need read only, so this is fine that rclone only copies data in one direction. If I sync via rclone, the file (e.g. PDF) cannot be opened by s3drive app because the preview cannot be loaded (there is an error message). I assume that when files are handled via s3drive, the thumbnail is generated additionally - which does not happen with rclone obviously and opening the file fails in s3drive ("File preview not available") (edited)
Are you using Linux? This is the only platform where PDF preview isn't yet supported due to lack of unified renderer. I've added a roadmap item to track it: https://s3drive.canny.io/feature-requests/p/pdf-preview-support-on-linux
Avatar
Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)
Avatar
Avatar
jggcvghhhh
Well, my SBC is Debian and using rclone 0.65. I try to open the PDF on iOS where it fails. My scenario (maybe clearer): stored data on linux SBC (raspberry) is sent via rclone to S3 and encrypted. Use iOS app to view the S3 bucket and try to open a synced PDF - and then the error message occurs in the iOS app and no file content is shown (edited)
Can you please create an item at https://discord.com/channels/1069654792902815845/1102236355645419550 please? In principle there shouldn't be any issue with previewing a PDF on iOS. Perhaps there is an issue with the Rclone setup / decryption. https://docs.s3drive.app/advanced/#setup-with-rclone (edited)
Avatar
I will... (edited)
Avatar
Avatar
jggcvghhhh
I will... (edited)
In which case the issue is somewhere around caching with the app when file preview runs. I am going to pass that for devs to check. Thanks for letting me know ! (edited)
Avatar
Gm community
markpash joined the server. 10/7/2023 10:58 AM
sky joined the server. 10/10/2023 9:16 AM
artemisia joined the server. 10/11/2023 10:02 AM
Avatar
Hi people! I am not sure where I should ask this so sorry if I am mistaken but do you have plans to introduce a CLI app?
Avatar
Hi, you can ask here no worries, I have however don't have the answer so you'll have to wait for @Tom to see it
Avatar
Avatar
artemisia
Hi people! I am not sure where I should ask this so sorry if I am mistaken but do you have plans to introduce a CLI app?
Hi there ! It's a matter of time. We plan to modify the current executable, so user can pass file path as an argument to upload: https://s3drive.canny.io/feature-requests/p/accept-file-as-path-argument This will likely grow over time with more and more options. What exactly would you like to achieve with a CLI? Bear in mind that since we're compatible with Rclone crypt you can achieve lots with an Rclone CLI: https://docs.s3drive.app/advanced/#setup-with-rclone
👍 1
gabrielebonini99 joined the server. 10/15/2023 3:45 PM
Avatar
Avatar
gabrielebonini99
Click to see original message
gabrielebonini99 10/15/2023 3:47 PM
Avatar
gabrielebonini99 10/15/2023 4:03 PM
Hello, is S3Drive going to replace PhotoSync for S3?
Avatar
Avatar
gabrielebonini99
Hello, is S3Drive going to replace PhotoSync for S3?
Hi, eventually yes, but no rush. We're solely focused on S3Drive for the past year or so. There are still couple features missing in S3Drive in order to reliably replace PhotoSync. Background upload features are still experimental in S3Drive and there is no function to check already uploaded assets. It will take us some time to deliver these features, before then PhotoSync can still be used. It has certain unique strenghts on Anrdroid that S3Drive doesn't yet. (edited)
Avatar
gabrielebonini99 10/15/2023 9:53 PM
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Avatar
A feature request: faceID … currently, the app is not protected and the password is in plain text
Avatar
Avatar
jggcvghhhh
A feature request: faceID … currently, the app is not protected and the password is in plain text
👍 1
Avatar
Avatar
gabrielebonini99
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Do you mean to zoom them during preview? If so, certainly we will have it added !
👍 1
Avatar
Just checking in, if I buy the subscription for S3Drive
12:15 PM
and then it expires
12:16 PM
Due to the fallback license, I'll be able to continue to use two way sync?
12:20 PM
And when it says Self-hosted, does that just include the S3-compatible storage? Or is there a server component for S3Drive that I'm missing?
Avatar
Avatar
CubityFirst
Due to the fallback license, I'll be able to continue to use two way sync?
That's correct, once your subscription expires you will still be able to use all functions and features that were available at the moment that you've bought yearly subscription. You will get bugfixes and security updates and certain improvements, but some new paid functions (that were released after) may not be available to you until you buy a new license. (edited)
Avatar
Avatar
CubityFirst
And when it says Self-hosted, does that just include the S3-compatible storage? Or is there a server component for S3Drive that I'm missing?
In this case we're providing just the software / clients. It's at your discretion to self-host or alternatively buy S3 from someone (it means that we're not providing S3 storage). I think we're going to change this slogan, as it causes some confusion. (edited)
Avatar
Yeah, it reads strangely.
ronco joined the server. 10/17/2023 2:27 PM
Avatar
Avatar
ronco
Click to see original message
SoftSoft joined the server. 10/20/2023 11:41 AM
Avatar
Hi @SoftSoft, welcome to S3Drive channel !
dorufin joined the server. 10/20/2023 2:34 PM
rootdgc joined the server. 10/21/2023 7:18 AM
7:20 AM
i already upgraded to pro, but after new version update I can't access all profiles, need help
Avatar
Avatar
rootdgc
Click to see original message
Manu joined the server. 10/21/2023 10:04 AM
Avatar
Avatar
rootdgc
i already upgraded to pro, but after new version update I can't access all profiles, need help
RimDumDim joined the server. 10/22/2023 5:41 AM
Ichigaya-9029 joined the server. 10/22/2023 2:52 PM
Avatar
Avatar
gabrielebonini99
Ok, thanks for the reply. Will there be the possibility to zoom photos on S3Drive?
Hi, this is to let you know that zooming photos will be included in a next release early next week !
👍 3
Avatar
gabrielebonini99 10/22/2023 6:07 PM
Ok, thank you 🙂
DamianPL joined the server. 10/23/2023 4:31 PM
simple joined the server. 10/23/2023 4:53 PM
Uplad joined the server. 10/25/2023 5:20 PM
SaraMcRuiz joined the server. 10/26/2023 6:48 AM
Krysius🦉 joined the server. 10/28/2023 10:53 AM
Lorian joined the server. 10/28/2023 6:17 PM
ProfRichD joined the server. 10/29/2023 9:14 PM
Kai joined the server. 10/30/2023 8:43 AM
Avatar
Avatar
Kai
Click to see original message
8:52 AM
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
Avatar
Avatar
Kai
Click to see original message
Good morning, If you buy the lifetime license you'll be able to use all of the current and future features permanently (we'll be constantly updating this list - https://docs.s3drive.app/plans). Our current packages are designed to be used with 3rd party S3 endpoints, MinIO included. We're evolving and we may adjust our offer, licensing options or pricing in the future, but this wouldn't apply retroactively. That is, if you buy the Lifetime today, you simply keep these terms as it is unchanged. The main reason that you need to login to S3Drive using the registered e-mail/password is so that we can fetch the license and enable the Pro/Ultimate features in your app. That's true, that we currently include ~10GB testing account, it's optional though and included even in the free account. In the future we may sell the managed accounts as per our Roadmap: https://s3drive.canny.io/feature-requests/p/managed-plans-100gb-500gb-2tb however this something we still work on and won't happen this year. (edited)
Avatar
Avatar
Kai
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
Speaking of some features being available on Windows. What features you refer to specifically? It's true that some of them (e.g. two-way sync) are available for free currently, this is because they're during Beta phase, and as per our: https://s3drive.app/pricing we say that "Basic" account which is free gets the: "Beta features preview". ... also if you use our managed 10GB account (currently only for testing) then all of the features are naturally available (but only on this account - you can connect to your MinIO or other S3 endpoint by using the "Switch profile" option in the Settings menu or top right profiles icon). This actually allows you to play with the app little bit, before you decide to connect to your S3 endpoint. We'll make it all more clear (especially with the 10GB testing account), I can fully understand your confusion. (edited)
Avatar
Avatar
Kai
Good Morning everyone, perhaps it is just me, but I am currently not 100% sure about the licensing options. I would like to use S3drive with my own Minio storage and don't want to use the S3drive storage. If I would buy the lifetime license I would need to sign in and therefore would automaticly have the S3drive storage mounted right? How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
How would the setup look like in my case without having my apps signed in? I want to use this strictly with my storage and it currently looks that the windows app offers all features without signing in?
At the moment you need to be signed with your login/e-mail password, so we can fetch the license, but you can select any other S3 endpoint and use it, be it MinIO, AWS, Backblaze or anything. In the future we may actually introduce concept of an "offline" license, so logging to the S3Drive client with your e-mail/password wouldn't be necessary, but this doesn't come without drawbacks as well. Some anti-abuse mechanisms would have to be implemented, so we don't end up like Windows's FCKGW-RHQQ2... license. This would either mean that you would have to generate some activation key on our website from time to time and paste it to the app... or once you activate features in your app with some activation key you would have to deactivate it before you could use it on some other Window's client.
Avatar
Thanks @Tom got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
9:28 AM
I don't mind to be logged in with the client for the license 🙂
Avatar
Avatar
Kai
Thanks @Tom got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
In principle that's how multiple profiles look like.
Avatar
Avatar
Kai
Thanks @Tom got it. And I double posted the question on Discord as there was no confirmation message after I used the form on the website, so I was not sure that it has been sent.
Thanks for letting me know about no confirmation message. We've "offloaded" that form to Formcarry and it seems there was some change on their end. We'll have it fixed. At least the message went through ! 🙂 (edited)
👍 2
Avatar
Requiring S3Drive to be online doesn't seem weird to me, I don't believe many people would use such an application offline, or rather in air-gaped environments. Allowing licensing servers in firewalls is quite common if you're on a restricted network, but even that should represent a minority. For mobile devices, they tend to be on BYOD networks or straight out over 4G/5G connections without any filtering. If you were offering a design software then sure, but for something that is connected by design it feels like a waste of time to me.
👍 2
Avatar
Hi there ! 👋 (edited)
borrk joined the server. 11/1/2023 12:22 PM
Avatar
Where can I find sync documentation? What is the difference between those options:
Avatar
Avatar
borrk
Where can I find sync documentation? What is the difference between those options:
Hi, unfortunately there is no documentation yet as the development on this is still going. Please find excerpt from the code: tocloud, // Upload to remote, delete remotely if file was deleted locally tocloud_keepdeleted, // Won't remove file remotely if it was deleted locally tocloud_compat, // If file is removed remotely, local won't know that, it will be reuploaded on a next ocassion In principle: "To remote" will upload file to remote and delete it remotely if it was deleted locally. If file is deleted remotely it won't get re-uploaded again. "To remote (don't delete remotely)" - the same as "To remote", except it will keep file on the remote even if it was deleted locally. The above 2 options require bucket versioning support. The "compatibility mode" doesn't require versioning API, however that makes it not aware of any file changes in between, so it's simply blind one way copy instead of sync. I hope that helps little bit. We'll build documentation once we sort couple challenges related to E2E encryption with syncing, as depending how we manage to solve these problems it may influence the available options.
1:15 PM
What's the ETA for syncing to/from android and background service for android? (edited)
1:19 PM
and do we get transfer stats somewhere? I just set the tool to upload ~2k files (20GB total) and I'm curious whether this will be done in a few minutes, or in a few days.
Avatar
Avatar
borrk
What's the ETA for syncing to/from android and background service for android? (edited)
There are significant improvements to Android background mode awaiting release (1.6.0) which will be deployed within a ~week. This will be part of: "Media backup" functionality. We will then be releasing the background mode on generic files/folders on Android combined with syncing modes, but there is no ETA just yet. We may release an MVP end of this year. There are no stats or aggregated info just yet... so far there is only "Transfers" tab with per file details, but nothing summarized as such. You may be able to get the required information from the Logs tab where you may find date and time when operations started and finished. (edited)
Avatar
Do you have debug logging? Now the tool is stuck processing single 86mb file and everything else is on waiting. The logs in GUI only say this:
6:51 PM
Avatar
Avatar
borrk
Do you have debug logging? Now the tool is stuck processing single 86mb file and everything else is on waiting. The logs in GUI only say this:
Is that one-way sync output? What platform? We know that sometimes upload queue gets stuck and timeout mechanism doesn't always reliably retry the process, but we haven't yet got to this.
Avatar
One way, Windows 10 to Backblaze.
Avatar
Avatar
borrk
One way, Windows 10 to Backblaze.
Is this issue consistent on your end? In other words if you restart the app does it fail in a same way? Anyway, I am going to prioritise this issue internally.
drak4r joined the server. 11/2/2023 9:31 AM
Jin joined the server. 11/2/2023 6:10 PM
Avatar
Avatar
Tom
Is this issue consistent on your end? In other words if you restart the app does it fail in a same way? Anyway, I am going to prioritise this issue internally.
Sadly, it is. I already restarted a few times and it's same story (though I think on different files).
Avatar
Hi there, question about usage. I'm using a tester account and I'm a bit confused. What is managed login? and how does it relate to the method of login where i connect with my access key and s3 endpoint etc? I guess it's showing up as two different profiles? Will a user be able to save a s3 bucket to a username and pw?
Avatar
Hi, managed user accounts are currently used for licensing and managed storage beta. They aren't mandatory and cannot be used to sync your app settings.
Avatar
Can I still have a user and Pw login which is connected to my s3 buckets without having to enter access keys to access them everytime?
Avatar
Avatar
Jin
Can I still have a user and Pw login which is connected to my s3 buckets without having to enter access keys to access them everytime?
If I understand you correctly, you're looking for a way to store and synchronize your S3 API credentials. It's pretty sensitive task and it's a job for a password manager, e.g. Bitwarden that we already support: https://s3drive.canny.io/feature-requests/p/password-autofill-support-for-bitwarden
Avatar
Avatar
Tom
If I understand you correctly, you're looking for a way to store and synchronize your S3 API credentials. It's pretty sensitive task and it's a job for a password manager, e.g. Bitwarden that we already support: https://s3drive.canny.io/feature-requests/p/password-autofill-support-for-bitwarden
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
Avatar
Avatar
Jin
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
I know it may be little confusing, but that's because we support multiple platforms, use-cases and user bases. In principle, S3Drive connects directly to S3 endpoint (we call it profile) which is identified and authorized by the couple details (Key ID, secret, gateway, bucket name, region etc.). These details are something we don't manage, can't access nor store on our servers. Our software makes a connection to these details and it's up to the user to configure S3Drive so it knows where to connect. To the best extent we make some guesses (e.g. we allow user to select existing buckets) or we auto-detect region, but still at the very minimum Key ID, secret and S3 provider name/gateway would be required. Some of the app features are behind the paywall (that's how we can support development of S3Drive). On mobile you can buy such features through in-app purchase. Since there is no single unified payment mechanism for all platforms we've built one, so you can buy "all-platforms" package on our website. These are assigned to an e-mail/password account that we manage which is used by S3Drive to determine if you can use paid features (in the future account may be used by couple other features, e.g. online sync between devices, but let's not complicate it for now). Additionally when you login using e-mail/password managed by us, you can access test 10GB+ account to test the app's functionality. Behind the scenes it's S3 credentials, but we generate and supply them for you based on your e-mail/password. In the future we will be providing managed accounts (e.g. 100GB, 500GB, 2TB etc.), which will be expansion of our current model. We aim to remain 100% S3 compatible and allow user to connect to external S3 endpoint (they may buy it from some S3 cloud/provider or they even might host S3 on their own using MinIO, SeaweedFS, Garage, OpenStack Swift, Ceph etc.) I hope that helps you to understand how it works and why we support different account types. ... (edited)
Avatar
Avatar
Jin
Thanks Tom, I'll check that out. My use case is that Im looking to give s3 bucket access to several members of a startup team some of whom may not be technical at all. I would like them to be able to login easily with their own permissioned access key and be able to access some files periodically while in the field. I thought s3drive could be that interface for them since it is available on all platforms and mobile as well. I guess I am confused about the current intended use case scenario for the app, where the login vs access key login are completely different profiles. If you could, please help me understand
... Since you want your coworkers securely login to the S3 endpoint there must be a way of passing the S3 details to the app. This can be an external mechanism, e.g. through password manager or app built-in mechanism (e.g. Single sign-on (SSO)), where user could provide their login/password (managed by some auth provider - where you can be an admin for instance). S3Drive would then contact that auth provider, authorize user and then request S3 credentials. I am happy to help you out on your use case. Do you mind sharing some info whether you have some auth system that's possible to connect to ... and where you get the S3 from? Does each user share bucket (and files as a result) with the other user? Is some private space/bucket required which shouldn't be by default accessible to other users? If you're not comfortable providing these details here, feel free to DM me. (edited)
Avatar
Avatar
Tom
... Since you want your coworkers securely login to the S3 endpoint there must be a way of passing the S3 details to the app. This can be an external mechanism, e.g. through password manager or app built-in mechanism (e.g. Single sign-on (SSO)), where user could provide their login/password (managed by some auth provider - where you can be an admin for instance). S3Drive would then contact that auth provider, authorize user and then request S3 credentials. I am happy to help you out on your use case. Do you mind sharing some info whether you have some auth system that's possible to connect to ... and where you get the S3 from? Does each user share bucket (and files as a result) with the other user? Is some private space/bucket required which shouldn't be by default accessible to other users? If you're not comfortable providing these details here, feel free to DM me. (edited)
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
3:14 PM
It is mostly me setting up the buckets and file systems and making them available to be accessed for reference by the users. They will not usually be uploading or sharing but it could happen
Avatar
Avatar
Jin
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
To not overcomplicate things from start, you could configure buckets, user API credentials and then restrict certain actions / locations using IAM (Wasabi does seem to support it) or simple restrictions that Backblaze offers - https://www.backblaze.com/docs/cloud-storage-application-keys (e.g. namePrefix) ... and then generate a JSON file, pass it to the user which could load it in-app using import feature. Not all details are required below, but this is to give you an idea that e.g. client-side encryption is also configurable. E.g. JSON: [ { "bucketName": "acme-internal-files", "keyId": "EVLJ2eXJukWUR9U17dyQqq6NPTi9mUu6scqpLCau", "applicationKey": "X9EiaepygvDK2S0fmMmFayehHoETDOphNP1r96PI", "endpoint": "https://s3.us-west-004.backblazeb2.com", "region": "us-west-004", "host": "s3.us-west-004.backblazeb2.com", "port": 443, "useSSL": true, "encryptionKey": "cG90YXRv", "rclonePlaintextKey": true, "filepathEncryptionEnabled": true, "rcloneDerivedKey": [ 116, 85, 199, 26, 177, 124, 134, 91, 132, ... ] } ] This may be a good start. We plan to implement QR code login, but the QR size limitation makes QR not a solution for all use cases. There are other means, e.g. QR code could transfer the "place holder ID" which would be then used to fetch the required details, but then again this setup would require more moving parts. We're very much open on this. (edited)
App keys control access to accounts and buckets.
Avatar
Avatar
Jin
Appreciate you taking the time! I am setting this up from scratch so there is no current system. Open to any solutions. The s3 will be wasabi or back blaze b2 with cloudflare to start with. Some bucket files will be shared with multiple users, some with only specific users and there is different levels of permission so some files are not accessible by default
We've technical capabilities to integrate with any provider and we've built direct integration with Backblaze management API, however this is something we can currently offer through Enterprise package only: https://s3drive.app/pricing as it's not the off-the-shelf product which end user can easily install and then configure with couple clicks. (edited)
Avatar
Avatar
borrk
Sadly, it is. I already restarted a few times and it's same story (though I think on different files).
We've dug down into this part of code and spotted couple issues and inefficiencies, expect improvements in this area in a next release within a ~week. In the meantime if you face any other challenges please let me know. Thanks !
Avatar
Avatar
Tom
To not overcomplicate things from start, you could configure buckets, user API credentials and then restrict certain actions / locations using IAM (Wasabi does seem to support it) or simple restrictions that Backblaze offers - https://www.backblaze.com/docs/cloud-storage-application-keys (e.g. namePrefix) ... and then generate a JSON file, pass it to the user which could load it in-app using import feature. Not all details are required below, but this is to give you an idea that e.g. client-side encryption is also configurable. E.g. JSON: [ { "bucketName": "acme-internal-files", "keyId": "EVLJ2eXJukWUR9U17dyQqq6NPTi9mUu6scqpLCau", "applicationKey": "X9EiaepygvDK2S0fmMmFayehHoETDOphNP1r96PI", "endpoint": "https://s3.us-west-004.backblazeb2.com", "region": "us-west-004", "host": "s3.us-west-004.backblazeb2.com", "port": 443, "useSSL": true, "encryptionKey": "cG90YXRv", "rclonePlaintextKey": true, "filepathEncryptionEnabled": true, "rcloneDerivedKey": [ 116, 85, 199, 26, 177, 124, 134, 91, 132, ... ] } ] This may be a good start. We plan to implement QR code login, but the QR size limitation makes QR not a solution for all use cases. There are other means, e.g. QR code could transfer the "place holder ID" which would be then used to fetch the required details, but then again this setup would require more moving parts. We're very much open on this. (edited)
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Avatar
Avatar
Jin
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Cool, if you have some thoughts about that I am more than happy to hear it out. In principle import functionality was designed to supplement current export functionality and the format isn't the most optimal if the JSON is to be built outside of the app. For instance there is a repetition: host / gateway, or if you want to set the encryption key, both encryptionKey and generated: rcloneDerivedKey must be provided. If there is a need we could certainly simplify the format, so things gets smartly derived if not present. (edited)
Avatar
Avatar
Tom
Cool, if you have some thoughts about that I am more than happy to hear it out. In principle import functionality was designed to supplement current export functionality and the format isn't the most optimal if the JSON is to be built outside of the app. For instance there is a repetition: host / gateway, or if you want to set the encryption key, both encryptionKey and generated: rcloneDerivedKey must be provided. If there is a need we could certainly simplify the format, so things gets smartly derived if not present. (edited)
so right now the best way to do this is to generate the json by exporting from the app and send it out to be imported? It certainly could be easier to build them outside of the app. If encrypting the files, what would you recommend using to decrypt the files? There will be non-technical people handling this so I'm not sure adding another app will be easier
Avatar
Avatar
Jin
so right now the best way to do this is to generate the json by exporting from the app and send it out to be imported? It certainly could be easier to build them outside of the app. If encrypting the files, what would you recommend using to decrypt the files? There will be non-technical people handling this so I'm not sure adding another app will be easier
Hi @Jin, If you don't need encryption to be enabled by default, generating JSON by hand is rather easy. If you need encryption, then you can either instruct your users to set up some password (possible preshared if you want data from all users to be readable with a single key) after they import profile or please wait ~two weeks (we're busy at the moment with transfer tab fixes and iOS background uploads) and we will be able to improve the JSON, so only encryptionKey field is required to setup the encryption. Speaking of decryption, it's an open format. Naturally you can use S3Drive (on any platform) to access encrypted data (you'll need to access bucket with data and setup E2E with the same password that was initially used for encryption). You can also mount data using as network drive (that's possible from S3Drive after clicking on tray icon). Alternatively you can access data using rclone command, as we're 1:1 compatible with their encryption: https://rclone.org/crypt/#file-encryption In that case please visit our docs to understand how you can set up rclone command: https://docs.s3drive.app/advanced/#setup-with-rclone Then you would be able to use commands like copy: https://rclone.org/commands/rclone_copy/ or sync: https://rclone.org/commands/rclone_sync/ or couple others depending on your needs. There are couple options out there. (edited)
RIANT joined the server. 11/7/2023 9:08 AM
Avatar
Hi, is this normal?
Avatar
Avatar
RIANT
Hi, is this normal?
Having a result of 2/68 is normal yes, there's always a few false positives due to the software being able to do "dangerous" things such as encrypt and transfer files, which is something done by ransomware for example.
👍 3
10:42 AM
That detection in your screenshot is based on machine learning, not known signatures, so this is a model that says "hmm, I'm having low suspicions this could be problematic software" and that's all. They can analyze features but not intent, that's their main issue.
Avatar
Avatar
RIANT
Hi, is this normal?
Alternatively you can use Microsoft verified binaries: https://docs.s3drive.app/install/#microsoft-apps Most people prefer .exe, however some prefer certain guarantees of Microsoft Store
lord_haliax. joined the server. 11/8/2023 6:53 AM
neryou joined the server. 11/8/2023 4:22 PM
lore joined the server. 11/9/2023 3:45 PM
ouhznai joined the server. 11/10/2023 1:03 AM
dan_16543 joined the server. 11/11/2023 12:31 AM
Avatar
Quite a lot of newcomers, welcome all!
DM joined the server. 11/13/2023 9:21 AM
barfittc joined the server. 11/13/2023 5:07 PM
quαcκ joined the server. 11/14/2023 1:23 PM
hugh198 joined the server. 11/15/2023 12:10 AM
Enthiran joined the server. 11/15/2023 12:55 AM
hugh1988 joined the server. 11/15/2023 2:43 AM
ceifeDeFi joined the server. 11/16/2023 10:04 PM
Avatar
Avatar
Jin
Thanks Tom, I tested the json solution and it seem to be a simple solution. I think we will go ahead with this and see how it works
Hi @Jin, I've wanted to let you know that we've improved and simplified JSON import in our today's release. You can use this example minimal version: [ { "bucketName": "bucket-photos", "keyId": "keyId", "applicationKey": "applicationKey", "endpoint": "https://s3.pl-waw.scw.cloud", "encryptionKey": "cG90YXRv" } ] This would configure all necessary things and enable encryption with password: potato, the encryptionKey is base64 encoded plaintext password. (edited)
FunTrade joined the server. 11/21/2023 4:16 AM
Avatar
Avatar
hugh198
Click to see original message
10:20 PM
hi, wondering if there any way to log in via web app and not have to put s3 credentials in each time? any way to have s3Drive remember them? thanks
Avatar
Avatar
hugh1988
hi, wondering if there any way to log in via web app and not have to put s3 credentials in each time? any way to have s3Drive remember them? thanks
Hi ! Configured buckets once setup should persist as they're stored in browser storage. Isn't it the case for you? Do you talk about managed credentials (login/password) or external S3 that you use? Once you setup your buckets you can then export them to JSON and have them re-imported on Web or other device. Alternatively you can create such JSON file by hand according to this format: https://docs.s3drive.app/setup/import/
Avatar
Avatar
Tom
Hi @Jin, I've wanted to let you know that we've improved and simplified JSON import in our today's release. You can use this example minimal version: [ { "bucketName": "bucket-photos", "keyId": "keyId", "applicationKey": "applicationKey", "endpoint": "https://s3.pl-waw.scw.cloud", "encryptionKey": "cG90YXRv" } ] This would configure all necessary things and enable encryption with password: potato, the encryptionKey is base64 encoded plaintext password. (edited)
Thanks Tom, I'll try it out and see how it works!
Avatar
Avatar
Tom
Hi ! Configured buckets once setup should persist as they're stored in browser storage. Isn't it the case for you? Do you talk about managed credentials (login/password) or external S3 that you use? Once you setup your buckets you can then export them to JSON and have them re-imported on Web or other device. Alternatively you can create such JSON file by hand according to this format: https://docs.s3drive.app/setup/import/
Hi tom, no it doesn't remember. I sign out and then sign back in and it only has my managed account with no s3 bucket attached.
Arke joined the server. 11/23/2023 4:28 AM
m joined the server. 11/23/2023 11:06 AM
Manu joined the server. 11/23/2023 10:05 PM
Juan joined the server. 11/26/2023 3:24 PM
Splat joined the server. 11/27/2023 9:59 PM
MrOvO joined the server. 11/28/2023 7:42 AM
Avatar
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
Avatar
Hi there, do you have any question regarding our desktop clients?
farmerjo joined the server. 11/29/2023 4:18 AM
Avatar
hi, when i click upload files, the app always loading like this
Avatar
Hi @Bryan, can I ask you what's your platform and S3Drive version?
Avatar
Avatar
Tom
Hi @Bryan, can I ask you what's your platform and S3Drive version?
I'm using Xubuntu and S3Drive 1.6.4
Avatar
Avatar
Bryan
I'm using Xubuntu and S3Drive 1.6.4
Thanks. Would that be .deb, .AppImage or Flathub release?
Avatar
Avatar
Tom
Thanks. Would that be .deb, .AppImage or Flathub release?
.AppImage
Avatar
Avatar
Bryan
.AppImage
That's interesting. Can I ask you to check if there is anything useful in Logs?
Avatar
Avatar
Tom
That's interesting. Can I ask you to check if there is anything useful in Logs?
no Logs menu?
Avatar
Avatar
Bryan
no Logs menu?
It's inside the "About" section.
Avatar
Avatar
Tom
It's inside the "About" section.
Avatar
Avatar
Bryan
Click to see attachment 🖼️
Right, nothing useful there. How about: "Upload folder" options, does it work for you? What's your Xubuntu version? Just wondering what's the major difference between e.g. Ubuntu. Currently running the .AppImage release on 23.04 and Upload files seem to be working just fine.
Avatar
Avatar
Tom
Right, nothing useful there. How about: "Upload folder" options, does it work for you? What's your Xubuntu version? Just wondering what's the major difference between e.g. Ubuntu. Currently running the .AppImage release on 23.04 and Upload files seem to be working just fine.
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
Avatar
Avatar
Bryan
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
It's likely related to different "file chooser" implementation on Xubuntu/Xfce, we're using library which apparently supports only: zenity, qarma and kdialog. https://github.com/miguelpruivo/flutter_file_picker/issues/1282#issuecomment-1551924613 I will add this item to our internal items and try to play around in Xubuntu. In the meantime would you be happy to try out the Flathub version? https://flathub.org/en-GB/apps/io.kapsa.drive (Please note that it awaits 1.6.4 release which will be likely available later today or tomorrow). (edited)
Avatar
Avatar
Bryan
nothing happened when Upload Folder clicked. I'm using Xubuntu 23.10
Alternatively can you try installing either: zenity or kdialog on your OS and see if it solves the issue? It it does we will add it as a dependency to .AppImage. https://forum.juce.com/t/native-filechooser-not-used-on-linux-xfce/26347
Some users of my application have reported a problem: the native FileChooser on Linux, using XFCE desktop, never shows. Instead, the JUCE one shows. I of course make sure that I set the “useOSNativeDialogBox” to true when instantiating the FileChooser. On any other system I tested (Windows, Mac, Linux (Ubuntu/Mint), this works fine though, so ...
Avatar
Avatar
Tom
Alternatively can you try installing either: zenity or kdialog on your OS and see if it solves the issue? It it does we will add it as a dependency to .AppImage. https://forum.juce.com/t/native-filechooser-not-used-on-linux-xfce/26347
i'm install zenity and now can upload folder
Avatar
Avatar
Bryan
i'm install zenity and now can upload folder
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
Avatar
Avatar
Tom
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
yes can Upload Files too
Avatar
Avatar
Bryan
yes can Upload Files too
Perfect, thank you for taking time to report this !
Avatar
Avatar
Tom
That's good news. I assume you can also: "Upload files"? I am going to include zenity in our releases.
thank you so much for your help🙏
ravalash joined the server. 11/30/2023 5:44 PM
laure joined the server. 12/2/2023 12:54 PM
MG joined the server. 12/3/2023 6:34 PM
Athrune joined the server. 12/3/2023 7:52 PM
Avatar
When I first put the S3 in S3Drive and it was successful, I saw the contents of my S3 (I only opened the folder) but why does my internet feel like it's downloading/uploading?
6:18 AM
Even though all I did was open the folder and didn't open the file or download/upload anything
Avatar
I opened S3Drive, the internet immediately changed to like it was downloading/uploading
7:04 AM
I closed S3Drive, the internet returned to normal, so I didn't dare open S3Drive because it would suck up my internet
7:05 AM
I deleted the data + reinstalled then put my s3 data into s3drive again, it still didn't work the internet remains in the download/upload position
Avatar
The problem is like this
9:53 AM
I don't do any file transfers but my internet network does things like downloading/uploading
Avatar
Hi @neryou, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
Avatar
Avatar
Tom
Hi @neryou, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
I did that by turning off 'Show image/video thumbnails' and I didn't have any problems with my network anymore.. Thank you for helping resolve sir
👍 1
Avatar
Avatar
neryou
I did that by turning off 'Show image/video thumbnails' and I didn't have any problems with my network anymore.. Thank you for helping resolve sir
Glad I could help !
backwards152 joined the server. 12/4/2023 8:46 PM
Macleod joined the server. 12/4/2023 9:42 PM
Avatar
Avatar
Tom
Hi @neryou, Thank you for you report. I would bet that it tries to generate an image thumbnails which unfortunately require whole file to be downloaded internally. Once thumbnail generation started, then even if you change the folder which doesn't contain images, the generation is still going in the background until it's done and the cache is built. Can you perhaps try disabling Image thumbnails in the settings and see if it helps? It's a tough problem (thumbnails) to solve with things like S3, because in order to generate an image thumbnail whole file must be downloaded. We could in theory offload your mobile/data plan and generate thumbnail on our servers, but that would break the E2E encryption model where by definition the unencrypted content isn't supposed to go outside your phone. We also generate video thumbnails, but that is surprisingly less intensive, because we can decode only first frames of a video in order to obtain an image, which weighs usually way less than a high quality picture. Please let me know if disabling image thumbnails helped to mitigate this issue. We could also implement a switch, e.g. load thumbnails only on Wifi or similar.
Have you considered creating your own version of thumbs.db that windows used to use? that way a thumbnail that has already been autogenerated (on first load/upload) can be used? It wouldn't work (could, if offloaded into the windows/apple cache location) on mounted drives, but would inside the app/other views. (edited)
9:45 PM
Also, currently on the website if you attempt to sign up for a plan, this is all that you see. This is in the latest Firefox on Windows, with uBlock + Tracking protection turned off.
9:46 PM
9:47 PM
console log of the data payload { "url": "/api/create-checkout-session", "data": { "price": { "id": "price_1NyfLNEv31gUd4RDtzV41wix", "interval": "year", "currency": "EUR", "unit_amount": 0 } }, "res": {} } (edited)
Alex Manea joined the server. 12/4/2023 10:55 PM
Avatar
Avatar
Macleod
Have you considered creating your own version of thumbs.db that windows used to use? that way a thumbnail that has already been autogenerated (on first load/upload) can be used? It wouldn't work (could, if offloaded into the windows/apple cache location) on mounted drives, but would inside the app/other views. (edited)
Thanks for your suggestion. We've got a pretty loose item in our Roadmap: https://s3drive.canny.io/feature-requests/p/generate-thumbnails Yes we plan to implement thumbnail generation and store it in one location, so other S3Drive instances (and if possible other viewers e.g. native OS file explorer) could utilize it. If the OS caches are available to integrate with without too much hacking then you can expect we'll have it implemented over the next couple months.
Once generated and stored, this would speed up thumbnail loading times on different devices, reduce stutter and reduce bandwidth usage dramatically.
Avatar
Avatar
Macleod
Also, currently on the website if you attempt to sign up for a plan, this is all that you see. This is in the latest Firefox on Windows, with uBlock + Tracking protection turned off.
Thanks, this is now resolved, sorry for the trouble.
Foxtrot Sierra joined the server. 12/5/2023 6:05 PM
jrd joined the server. 12/6/2023 4:20 AM
Avatar
hey just paid for a ultimate account and its telling me i have a testing account
Avatar
Avatar
jrd
hey just paid for a ultimate account and its telling me i have a testing account
Hi @jrd, thank you for supporting the project. Testing account dialog is displayed once you "click into" the e-mail/password credentials regardless of whether you have Business, Ultimate, Pro or free account. There is a ~10-12GB account allocated, so user can test the app without need of connecting to external S3 provider. In order to set up new buckets please click the top right icon, you will then end up on Profiles page, from which you shall be able to add (or you can import via JSON - https://docs.s3drive.app/setup/import/ ) more buckets. In both Profiles page and drawer menu (as per attached screenshots) you shall be able to see your current plan name, e.g. Ultimate. If your license wouldn't work you would receive a yellow prompt as on the attached screenshot, if this is not what you're getting things shall be working just fine. Please let me know if this helps to resolve your issue. Thanks ! (edited)
Zero Knowledge E2E encrypted storage compatible with any S3 provider
Avatar
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
Avatar
Avatar
jrd
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
Ok clearly this isn't how it's supposed to work. Let me check couple things. I will get back to you promptly. (edited)
👍 1
Avatar
Avatar
jrd
did this previously and was getting drive mount requires pro error when trying to mount drive, just followed your steps again and still getting same error
In fact we've had an issue related to Business license which is now resolved. You shouldn't need to logout/login, but if you could visit Profiles page first (once again) and then try to set up the drive mount. (edited)
Avatar
Avatar
Tom
In fact we've had an issue related to Business license which is now resolved. You shouldn't need to logout/login, but if you could visit Profiles page first (once again) and then try to set up the drive mount. (edited)
it appears to be working now, is there any way to automate the profile import ?, we are looking to deploy this for a client who needs to centralise there storage for off shore graphics designer team they have.
Avatar
Avatar
jrd
it appears to be working now, is there any way to automate the profile import ?, we are looking to deploy this for a client who needs to centralise there storage for off shore graphics designer team they have.
That's great, thanks for letting me know. In our standard version we have the JSON import: https://docs.s3drive.app/setup/import/#unencrypted-bucket We plan to come up with a workflow where end user could provide e.g. HTTPS address of SAML / OIDC SSO provider which could then in return reply the necessary S3 credentials for app to pick up and log user in. Once its built I am not sure if it's going to end in our public release, it might end up in our Enterprise version anyway. What would be your preferred approach for credentials management? (edited)
Avatar
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
Avatar
Avatar
jrd
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
We'll be improving in these areas. Rclone will be bundled with the app. Speaking of WinFSP, we shall be able to automate it little bit, at best detect and install it on the OS if it doesn't exist... at worst display clear dialog prompting user to click on and install software.
Avatar
Avatar
jrd
not to sure JSON import and having to install winfsp makes it a manual process and hard to change the bucket access key if a staff member leaves.
Speaking of credentials import, we need to spend some time to think about the options. Certainly some party needs to take this integration burden on them. We've modules to integrate with MinIO and Backblaze, but it's not really much given that every S3 provider has different API for managing credentials... so we've thought we'll kick start this by providing minimialistic generic API for credentials exchange, so our clients could implement it (and automate to some degree) themselves. There will be time in the future to further expand in this area, but our current priorities are elsewhere.
Rob joined the server. 12/6/2023 8:38 PM
Avatar
Upgraded myself from Pro Yearly to Ultimate Lifetime on the website then cancelled my Pro Yearly on Stripe, I hope this won't cause issues on your or Stripe's end. I also believe an automated cancellation is expected when you get another license, would I have been billed if I didn't check Stripe after upgrading?
Avatar
Avatar
Xenthys
Upgraded myself from Pro Yearly to Ultimate Lifetime on the website then cancelled my Pro Yearly on Stripe, I hope this won't cause issues on your or Stripe's end. I also believe an automated cancellation is expected when you get another license, would I have been billed if I didn't check Stripe after upgrading?
Thank you for upgrading it really means a lot and helps us to deliver quicker on our: https://s3drive.app/roadmap Since our Stripe integration isn't currently aware of the upgrade, with our current implementation you would've been billed again. We'll be automating this process, in the meantime we're handling upgrades/refunds manually. Given that you obtain two valid licenses now, one perpetual fallback Pro (we've discontinued "perpetual fallback" model, but existing licences are valid forever - https://s3drive.app/faq?q=perpetual) and second one Ultimate, do you want me to cancel and refund (prorate'd) the Pro or perhaps you want to reassign it to a different account?
Avatar
I don't want a refund that's for sure, but I don't need the license either since I have a better one now. How about a giveaway here?
11:09 AM
The giveaway doesn't need to be a discontinued perpetual fallback license either, it could be a standard 6-months Pro license for example.
11:12 AM
In conclusion, feel free to do as you please as I don't really mind. I haven't used the app for some time and just got the Ultimate Lifetime license to support you.
❤️ 1
Avatar
Any ways to make a onetime donation for supporting? I buyed the Android version and it fits my need
Avatar
Avatar
Morethanevil
Any ways to make a onetime donation for supporting? I buyed the Android version and it fits my need
I am really happy to hear that. I really do appreciate your donation offer, but I think the best support that we can get at this stage is to spread the love and information about S3Drive, leave us a review, or leave comment/recommendation on Reddit or other social media platform. We'll be soon needing help with the translations if that's something you would be interested in. If you ever need to upgrade your Android license to all devices (Ultimate Lifetime license): https://s3drive.app/pricing please do let me know ! (edited)
Avatar
And how about a pro license for one year as a giveaway? 🤔
12:37 PM
People can try it out this way
12:38 PM
You are the only one providing a working flatpak for S3 😁
🐧 1
Avatar
I don't think S3Drive is mature enough to host giveaways, raising money is something but adding burden isn't worth it for now in my opinion.
Avatar
Picked up an Ultimate Lifetime license aswell, I look forward to seeing where this goes c:
Avatar
I'm not sure if I'm just blind or something
1:10 PM
but I can't find where to activate the license in the app lol
rjp joined the server. 12/10/2023 1:35 PM
Avatar
Avatar
CubityFirst
Picked up an Ultimate Lifetime license aswell, I look forward to seeing where this goes c:
Thanks for supporting the project. Our roadmap (https://s3drive.canny.io/) is full of features and despite of our constant releases it actually grows faster than we can deliver, so if you would like us to prioritize certain features please express your interest by either adding a vote or just simply mention it here. Speaking of next major releases. We're on track to deliver support for plenty other back-ends: https://rclone.org/overview/ (please find the list) that will further open-up possibilities within the app.
Avatar
Avatar
CubityFirst
but I can't find where to activate the license in the app lol
Once you get it you'll need to login using your account within S3Drive. You should then be able to see your managed/license account in the Profiles like this, allowing you to use all of the Pro and Ultimate features.
Avatar
Got it. Thanks 🙂
boxtop joined the server. 12/11/2023 9:06 AM
Avatar
Avatar
boxtop
Click to see original message
SHLD joined the server. 12/16/2023 10:56 AM
h joined the server. 12/17/2023 12:25 AM
Avatar
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
❤️ 1
7:18 AM
I'm open to adding the feature myself if those parts of the app are open source.
7:19 AM
Also was wondering if file syncing (from cloud to phone storage) is currently possible on Android?
Avatar
Avatar
Cold Fusion
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
Hi there and thank you for supporting the project. Since we run a cross-platform project, we're not using native players on each platform, but https://pub.dev/packages/media_kit library which in turn may or may not use native media player, but still aims to be optimized enough to provide a good playback experience. The reason that we've went with that library was that on top of fair mobile experience it provided pretty good desktop playout (including H/W support)... also we provide streaming of encrypted videos (which is somewhat complicated and fragile) and we were looking for a single library which we could adjust rather than doing that critical changes for every player on every platform. What's your goal behind using built-in player? Would you like to stream/player the video outside of S3Drive somehow or our existing player experience doesn't match your expectations? Technically we could fallback to https://exoplayer.dev/ on Android, but since we try to find a good balance between usability/functions/features and dev/maintenance costs we would really need to find a good reason to do so.
Avatar
Avatar
Cold Fusion
Hi Tom! Just bought the S3 Drive lifetime ultimate. Love your work. I might have a little bit of a unique use case, but wanted to submit a minor feature request. I'm running an S3 object storage on my home server (using minIO driver) and your app works with it very well. I have a large media library and was wondering if it's possible to allow streaming content directly into the built in media (video and audio) players on the Android (14) system? Rather than the app? (Using Content Provider component, and content://... URLs?)
Speaking of content://, since we operate on network resources, what we get with S3 is just a network URL, that we don't store locally (except the video cache) and pass directly to the video player. Since data isn't stored on Android device locally I don't think there is a method to expose it as a content URI. If I understand little bit more about your use case I might be able to come up with some other approach. (edited)
Avatar
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
Avatar
Do I have any offers on lifetime purchase. Please ?
9:56 PM
Or any promotion code
Avatar
Avatar
Cold Fusion
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
S3Drive aims to be versatile in terms of supported files and media formats, so if audio playing isn't working as expected we will have a fix for that pretty soon. (edited)
Avatar
Avatar
Cold Fusion
Understood. My main reason for wanting to use a built in player is that the current music player view doesn't have any playback controls when playing audio and just shows a black screen while playing the audio. Not sure how easy it is to fix that, or if it's just easier to pass on a stream URL to an external player. My use case: Occasionally explore my data store, playing media content here and there (usually looking for something in the hierarchy of folders) before syncing it down to my device. Ideal use case: Just play everything right in the S3Drive app removing the need to sync files to my device, but I understand that S3Drive is not a media player. That's why I was wondering if it could be possible to integrate it with system media players.
In a next release there will be experimental player that supports playlists (you would be able to Play multiple audio files)... and supports background play-out. It's not perfect and there is no dark mode just yet, but it should work way better than what we have currently. Soon we shall be able load metadata, album name, cover picture... but we need to analyze what's feasible. How does that sound?
Avatar
Avatar
ParadoxDude
Do I have any offers on lifetime purchase. Please ?
Hey, You've convinced me to do the last one this year and before the price hike. https://s3drive.app/pricing?q=lifetime Please use: WINTER20 to get 20% 🛒 discount for Lifetime license s3drive. There are only 3 codes to redeem, so whoever is fastest gets S3Drive cheaper. Happy buying ! 🛍
Tom pinned a message to this channel. 12/19/2023 10:49 AM
Avatar
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
Avatar
Avatar
Bryan
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
Hi @Bryan, we received couple user reports that AppImage doesn't work as expected and we've included many improvements (related to dependencies and framework updates), these are already included in a next 1.7.0 release which is due to be released end of this month. I've created dev build for you to try out early and see if it resolves your issues, can you please give it a go and let me know if you get anything else than a blank white page? https://github.com/s3drive/app/releases/tag/1.7.0
Avatar
Avatar
Tom
Hi @Bryan, we received couple user reports that AppImage doesn't work as expected and we've included many improvements (related to dependencies and framework updates), these are already included in a next 1.7.0 release which is due to be released end of this month. I've created dev build for you to try out early and see if it resolves your issues, can you please give it a go and let me know if you get anything else than a blank white page? https://github.com/s3drive/app/releases/tag/1.7.0
I have tried version 1.7.0 and still blank white page like before
Avatar
Avatar
Bryan
I have tried version 1.7.0 and still blank white page like before
Is this running under a VM or some container perhaps?
Avatar
Avatar
Tom
Is this running under a VM or some container perhaps?
no, i'm running on real machine (laptop)
Avatar
Avatar
Bryan
no, i'm running on real machine (laptop)
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
Avatar
Avatar
Tom
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
Avatar
If you have an AMD GPU yes that should do. (edited)
Avatar
Avatar
Tom
I can't tell exactly what's the issue and we weren't able to try all distros, but the usual cause of a blank screen was lack of GPU H/W acceleration which our UI depends on (hence I asked about VM environment where H/W not always work properly). Does your environment have H/W acceleration enabled? Can you please tell the output of: glxinfo | grep "direct rendering" ? (edited)
return "Direct Rendering : Yes"
Avatar
Avatar
Bryan
return "Direct Rendering : Yes"
... and despite that still white screen? Can you please try resizing this blank windows, any visible change / screen artifact?
Avatar
Avatar
Tom
... and despite that still white screen? Can you please try resizing this blank windows, any visible change / screen artifact?
still blank white in full screen
Avatar
Avatar
Bryan
still blank white in full screen
I will make an internal ticket, can you please provide me your GPU details, desktop environment (xfce, GNOME, etc) and Void linux release version?
Avatar
Avatar
Bryan
still blank white in full screen
In the meantime would you be happy to try out the Flathub release? https://flathub.org/en-GB/apps/io.kapsa.drive
Avatar
Avatar
Tom
I will make an internal ticket, can you please provide me your GPU details, desktop environment (xfce, GNOME, etc) and Void linux release version?
GPU: AMD ATI Radeon R4/R5 Graphics DE: Xfce Release version: rolling release
Avatar
Avatar
Tom
In the meantime would you be happy to try out the Flathub release? https://flathub.org/en-GB/apps/io.kapsa.drive
i will learn about it
Avatar
Avatar
Tom
In a next release there will be experimental player that supports playlists (you would be able to Play multiple audio files)... and supports background play-out. It's not perfect and there is no dark mode just yet, but it should work way better than what we have currently. Soon we shall be able load metadata, album name, cover picture... but we need to analyze what's feasible. How does that sound?
PLAYLISTS, background play and metadata? That sounds amazing! Can't wait for the next release now 😁
7:28 PM
Seriously, that sounds awesome.
Avatar
Just bought an ultimate lifetime for all platforms.
❤️ 1
Tebo joined the server. 12/20/2023 12:29 PM
Avatar
Love that you're doing this, it's what I was looking for. I have a question about S3 behavior and pricing. My understanding from reading through their replication FAQ is that any update to a file in S3 creates a copy and incurs a cost because the default is files that are uploaded are all immutable objects . Since I'll have a lot of large files I'm concerned about this -- can you help me understand, is my fear unfounded, or is there a strategy I need to employ - maybe using S3Drive helps with this - to keep my storage from ballooning, maybe with atomic file updates? Just concerned about 'surprise' AWS bills.
Avatar
Hi, editing large files will indeed require uploading the whole file every time. If you overwrite the old file and don't enable versioning, you should be fine because you don't store more data once the upload is finished, and AWS doesn't bill you for ingress to my knowledge. You will however need to be careful about egress fees if you automatically download new versions elsewhere, and operations themselves since more files (no matter their size) means more operations as a whole. You may want to wait for the Rclone integration, use a more standard file storage system for live files such as Google Drive, then use S3 to archive the ones you no longer plan to edit but still want to keep around.
12:55 PM
The best way to know would be to perform a small scale test, see how everything behaves and analyse your S3 operations and costs on the AWS console.
_guest joined the server. 12/20/2023 3:22 PM
Avatar
Avatar
Xenthys
Hi, editing large files will indeed require uploading the whole file every time. If you overwrite the old file and don't enable versioning, you should be fine because you don't store more data once the upload is finished, and AWS doesn't bill you for ingress to my knowledge. You will however need to be careful about egress fees if you automatically download new versions elsewhere, and operations themselves since more files (no matter their size) means more operations as a whole. You may want to wait for the Rclone integration, use a more standard file storage system for live files such as Google Drive, then use S3 to archive the ones you no longer plan to edit but still want to keep around.
Thanks for your reply, it’s helpful and I’ll check out Rclone.
Avatar
Avatar
Tebo
Thanks for your reply, it’s helpful and I’ll check out Rclone.
You can wait for the next S3Drive update that will include Rclone features, so you won't have to install multiple software for the same task
👍 1
6:30 PM
And you're welcome, glad I could help!
Roberto joined the server. 12/22/2023 1:51 PM
cam joined the server. 12/26/2023 11:43 AM
Cam joined the server. 12/26/2023 5:46 PM
AdamK joined the server. 12/27/2023 6:55 PM
avantartist joined the server. 12/28/2023 4:52 PM
nlitend1 joined the server. 12/28/2023 10:52 PM
EL joined the server. 12/29/2023 10:12 AM
Avatar
Hello! @everyone
Pavitra joined the server. 12/30/2023 6:12 AM
hylbaek joined the server. 1/1/2024 1:16 PM
Ed joined the server. 1/1/2024 9:18 PM
Motorolo joined the server. 1/3/2024 10:33 AM
iyxan23 joined the server. 1/3/2024 1:39 PM
Avatar
Avatar
Bryan
Hi, i'm trying to run S3Drive 1.6.5 AppImage on Void Linux, but only show blank white page. Are there any dependencies that might need to be installed?
after updating my operating system today, now the app is working😁
👍 1
Avatar
Good news, although that means we won't know what caused the issue 😄
😆 1
Avatar
Avatar
Xenthys
Good news, although that means we won't know what caused the issue 😄
one of the updates was glibc, I don't understand about system but could it be because of that?
Avatar
depends on the version you had and what S3Drive requires, but even Debian's glibc should be alright so unless VoidLinux was seriously outdated I doubt it
👍 1
Avatar
hi all, I tried using the flatpak version but it only shows a blank white screen, it also seems like its not updated yet (still at 1.7.0, while latest is 1.7.1 i believe)
6:36 AM
for the meantime im using the 1.7.1 appimage which works well
6:38 AM
also, i noticed an issue with moving files, it prepended the destination directory to the "file-to-be-moved"?? so moving a file named file.png to test/ would rename it to testfile.png and the file is not moved the directory
6:39 AM
for now im renaming the files manually like this, which seemed to work x)
Avatar
anyways, as a new user, i gotta say, the idea of using s3 for personal storage is really cool. i can now make use of cheap s3 services from my local hosting provider to host my files rather than paying to google, really love the idea. tho the app is kinda buggy sometimes, i hope it could get more polished in the future <3
6:49 AM
i have a bit of a rant, i really need to know how deep i'm opening a folder is. it'd be awesome to have this display breadcrumbs instead of the name of the current folder. thanks
Avatar
Avatar
iyxan23
hi all, I tried using the flatpak version but it only shows a blank white screen, it also seems like its not updated yet (still at 1.7.0, while latest is 1.7.1 i believe)
There is a delay before Flathub picks up our release, we don't know how to resolve it just yet, so we wait patiently. We'll likely will have to tweak sandbox / folder permissions for the 1.7.1 sync feature to be able to interact with the local FS.
👍 1
Avatar
Avatar
iyxan23
also, i noticed an issue with moving files, it prepended the destination directory to the "file-to-be-moved"?? so moving a file named file.png to test/ would rename it to testfile.png and the file is not moved the directory
Sorry for that. It seems that we've introduced couple bugs related to copy/move in 1.7.0, we've now prioritized this and shall be able to release a hotfix at some point today.
Avatar
Avatar
iyxan23
i have a bit of a rant, i really need to know how deep i'm opening a folder is. it'd be awesome to have this display breadcrumbs instead of the name of the current folder. thanks
Cool idea, I've added it as a feature request: https://s3drive.canny.io/feature-requests/p/add-folder-breadcrumbs-in-the-navigation Since it's a small feature with pretty good value it's likely it will be implemented by the end of this month.
bastian joined the server. 1/5/2024 10:04 AM
Avatar
thanks tom for the quick response!
Avatar
Stupid question - I forgot my password ( https://s3drive.app/signin ) , the reocvery process sends me an email with a token, now I can view my lifetime purchase, but can't change or set a new password…
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
Avatar
passwort rest works now with android app but not on my mac
Avatar
@bastian E-mail/password change is available in the S3Drive web settings - https://web.s3drive.app/settings There is a link at the bottom of the account page. You should be logged in automatically if you're logged in on https://s3drive.app/account In the future account details change will be possible on our main website.
👍 1
Avatar
InfiniteAds559 1/6/2024 6:56 AM
Hi Tom, does changing folder names only available to paid accounts?
Avatar
Avatar
InfiniteAds559
Hi Tom, does changing folder names only available to paid accounts?
Hi, do you mean folder rename within bucket? Nope, it's free 🙂 Do you have any issue with folder name change?
Avatar
InfiniteAds559 1/7/2024 5:42 PM
all is good after updating. I used to get "Invalid Header"
mrherbs joined the server. 1/9/2024 4:42 PM
Snowflake joined the server. 1/10/2024 2:47 AM
vripan joined the server. 1/10/2024 11:24 AM
skybrow_1 joined the server. 1/12/2024 10:09 PM
Avatar
Avatar
Tom
Hi, do you mean folder rename within bucket? Nope, it's free 🙂 Do you have any issue with folder name change?
InfiniteAds559 1/13/2024 12:57 AM
Looks like I'm able to replace the folder name, but when I open the app again the folder name reverts back to original name, Same behaviour when creating a new folder
Avatar
Avatar
InfiniteAds559
Looks like I'm able to replace the folder name, but when I open the app again the folder name reverts back to original name, Same behaviour when creating a new folder
What's your S3 provider? When you say "same behaviour when creating a new folder", do you mean that the newly created folder doesn't persist or anything else?
Avatar
Avatar
Tom
What's your S3 provider? When you say "same behaviour when creating a new folder", do you mean that the newly created folder doesn't persist or anything else?
InfiniteAds559 1/13/2024 1:23 PM
That's right. S3 provider is Storj
Avatar
InfiniteAds559 1/13/2024 2:37 PM
Has the android drive mount been implemented yet?
Avatar
Avatar
InfiniteAds559
That's right. S3 provider is Storj
Can you make sure that Versioning is disabled in the Settings? Storj doesn't support versioning just yet, but enabling this option might cause such weird behavior.
Avatar
Avatar
InfiniteAds559
Has the android drive mount been implemented yet?
It's released, but it doesn't seem to be visible on anything below Android 14 and is read-only. Within a couple days we shall have it fixed and if possible we may implement basic write operations.
Avatar
Avatar
Tom
It's released, but it doesn't seem to be visible on anything below Android 14 and is read-only. Within a couple days we shall have it fixed and if possible we may implement basic write operations.
InfiniteAds559 1/13/2024 3:32 PM
I'm on Android 14. All I can see are OneDrive and Google Drive
Avatar
Avatar
Tom
Can you make sure that Versioning is disabled in the Settings? Storj doesn't support versioning just yet, but enabling this option might cause such weird behavior.
InfiniteAds559 1/13/2024 3:44 PM
Thanks, this fixes the folder renaming issue
ironrinn joined the server. 1/13/2024 4:19 PM
kinopi joined the server. 1/13/2024 9:15 PM
Avatar
Avatar
InfiniteAds559
I'm on Android 14. All I can see are OneDrive and Google Drive
We're awaiting a 1.7.4 fix release regarding the drive mount on Android. It's still read-only, but the visibility issues shall be resolved.
👍 1
AA joined the server. 1/16/2024 1:21 AM
Avatar
Morethanevil 1/16/2024 7:53 AM
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
Avatar
Avatar
Morethanevil
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
Hi there, our aim was to display raw data in that functionality, so user has chance to verify the file integrity. Adding e.g. suffix (889KB) wouldn't hurt though, we will get it added in a next release !
👍 1
Avatar
Avatar
InfiniteAds559
I'm on Android 14. All I can see are OneDrive and Google Drive
Hi, 1.7.4 is there. I am wondering if you can now see S3Drive? Please make sure that you've mount enabled in the settings (you can also try toggle off, then on again to reset settings). Another issue that we find is that on some phones e.g. Samsung mount isn't visible in the installed Files app, probably such space is reserved only for Big Guys, but no worries you can actually enable the native Files app either from the phone settings menu or by installing a shortcut to it: https://play.google.com/store/apps/details?id=com.marc.files&hl=en&gl=US
This app is a shortcut to the file manager of the settings app.
Avatar
Avatar
Morethanevil
A small improvement request. When viewing file details, it would be nice if the size would be in a human readable format.
As promised, we'll have it included in a next release:
Avatar
Cool thank you It helps me to quick check if a certain backup is successful ☺
Avatar
Avatar
Tom
Hi, 1.7.4 is there. I am wondering if you can now see S3Drive? Please make sure that you've mount enabled in the settings (you can also try toggle off, then on again to reset settings). Another issue that we find is that on some phones e.g. Samsung mount isn't visible in the installed Files app, probably such space is reserved only for Big Guys, but no worries you can actually enable the native Files app either from the phone settings menu or by installing a shortcut to it: https://play.google.com/store/apps/details?id=com.marc.files&hl=en&gl=US
InfiniteAds559 1/17/2024 12:47 AM
I can now see it mounted on my Files app. Amazing work, Tom!
Deleted User joined the server. 1/17/2024 2:19 AM
tengas23 joined the server. 1/17/2024 2:22 AM
justin joined the server. 1/17/2024 2:29 AM
frpnzxxx joined the server. 1/17/2024 2:33 AM
Avatar
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
Avatar
Avatar
frpnzxxx
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
InfiniteAds559 1/17/2024 3:40 AM
It may be because it's encrypted?
Avatar
is there any way to view the images?
Avatar
May I ask what is the maximum storage capacity? 👇 If I consumed 4TB Storage what is the cost? Thanks in advance (edited)
Avatar
Avatar
frpnzxxx
HI! When connected to Google Drive, i cannot view the images, I have to download it to view, here is a screenshot
Hi, We haven't yet implemented image preview for non-S3 back-ends, it will be available around Q1/Q2 2024 - https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends
Avatar
Avatar
tengas23
May I ask what is the maximum storage capacity? 👇 If I consumed 4TB Storage what is the cost? Thanks in advance (edited)
Hi, We're not selling storage just yet, the Ultimate plan allows you to use all of the available features of the app, but you'll need to choose the storage provider yourself, please find the guide: https://docs.s3drive.app/setup/bucket/#providers Once you click on the registered account regardless if you have a free or Ultimate plan you are getting 10GB testing account. there is a relevant monit to let you know that it's only for testing purposes. We will be providing plans this year, including 4TB and potentially lifetime deals, but that's not yet ready.
Zero Knowledge E2E encrypted storage compatible with any S3 provider
👍 1
Avatar
If I could have a lifetime 10 TB deal I'd be so stoked, it would cost so much upfront tho 💸
Stem joined the server. 1/17/2024 3:14 PM
Stem joined the server. 1/17/2024 8:18 PM
mrfreed joined the server. 1/18/2024 12:39 AM
Avatar
Avatar
mrfreed
Click to see original message
/Chris joined the server. 1/18/2024 11:16 PM
Sergio Visinoni joined the server. 1/19/2024 12:10 PM
Avatar
InfiniteAds559 1/20/2024 5:08 AM
hey tom, is there difference in github apk vs playstore?
Avatar
@InfiniteAds559 Hi, currently yes, APK supports folder syncing from local FS: https://docs.s3drive.app/install/#apk-release Google Play release doesn't yet support it, but we're working on convincing Google that this use case is legitimate. (edited)
Avatar
InfiniteAds559 1/20/2024 3:20 PM
I see. is that why I wasn't able to move files? With folder sync, it basically backs up (if chose to) my desired folder? (edited)
3:22 PM
oh and does it auto update?
meticoeus joined the server. 1/21/2024 8:35 AM
Avatar
Avatar
InfiniteAds559
I see. is that why I wasn't able to move files? With folder sync, it basically backs up (if chose to) my desired folder? (edited)
Sorry, can you refresh me on the move files issue? If issue still persist, can you please create a support item? Regardless, it's not related to Android permission issue that I've mentioned. Speaking of sync modes, there are 4 of them. On desktop it uses "file watcher" to sync immediately, on mobile syncing starts when app starts (configurable in the settings). Periodic sync (e.g. once every 15 minutes) will come soon at some point we will also implement "foreground live sync", that will run constantly, however we still haven't exactly decided how to implement with battery life in mind. (edited)
kimonk joined the server. 1/22/2024 11:11 AM
Avatar
Avatar
kimonk
Click to see original message
Avatar
Avatar
kimonk
Click to see original message
Sticker
Archer Allstars joined the server. 1/23/2024 1:44 AM
star_ice_cream joined the server. 1/23/2024 2:36 PM
saul goodman joined the server. 1/24/2024 8:08 AM
ReplaX joined the server. 1/24/2024 3:25 PM
Crims joined the server. 1/25/2024 8:15 PM
daison joined the server. 1/26/2024 1:22 AM
Astro joined the server. 1/27/2024 12:31 PM
Avatar
Hi hi
Avatar
Hello, I'm trying to install s3drive .deb version, but libmpv1 not available on debian bookworm repo
Avatar
Morethanevil 1/27/2024 6:47 PM
Libmpv1 is outdated, use flatpak
👍 1
Avatar
The .deb package should accept libmpv2 tho
6:47 PM
I believe @Tom will have to see if that dependency is supported and can be allowed within the Debian package metadata, aka. install either libmpv1 or libmpv2.
Avatar
Avatar
Bryan
Hello, I'm trying to install s3drive .deb version, but libmpv1 not available on debian bookworm repo
Hi there, Would you be happy to try out this pre-release? https://github.com/s3drive/deb-app/releases/tag/1.7.7 I've added the: libmpv2 as an alternative, but don't really have capacity at the moment to test things out. Ideally movies should play out as normal, as MPV dependency is required by media library that we use: https://pub.dev/packages/media_kit (edited)
Avatar
Avatar
Xenthys
I believe @Tom will have to see if that dependency is supported and can be allowed within the Debian package metadata, aka. install either libmpv1 or libmpv2.
Thanks for the hint with the .deb alternative !
Avatar
Avatar
Tom
Hi there, Would you be happy to try out this pre-release? https://github.com/s3drive/deb-app/releases/tag/1.7.7 I've added the: libmpv2 as an alternative, but don't really have capacity at the moment to test things out. Ideally movies should play out as normal, as MPV dependency is required by media library that we use: https://pub.dev/packages/media_kit (edited)
Installed successfully and running normally😁
Avatar
Avatar
Bryan
Installed successfully and running normally😁
That's great, so we've managed to fix it all together. Thanks ! (edited)
s3drive 2
💪 1
Deleted User joined the server. 1/28/2024 8:42 PM
Philipp joined the server. 1/28/2024 8:43 PM
povey joined the server. 1/28/2024 11:37 PM
Bad joined the server. 1/29/2024 2:25 PM
JakeABQ joined the server. 1/29/2024 2:35 PM
benoit joined the server. 1/29/2024 3:32 PM
Avatar
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Avatar
It appears to be a package issue, S3Drive works with both to my knowledge so it should take any available between .1 and .2
Avatar
Avatar
benoit
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Thanks for your report. It seems we've introduced a bug with a recent release which in theory was supposed to pick up right: libmpv version. We're working to have it resolved promptly, please bear with us.
Avatar
Avatar
benoit
Just did a flatpak install on fedora and then flatpak run gives me: /app/extra/local/lib/s3drive/kapsa: error while loading shared libraries: libmpv.so.2: cannot open shared object file: No such file or directory (This is first time I've used flatpak though I did a test install on another app and that ran ok.) I can see that /var/lib/flatpak/app/io.kapsa.drive/..... has libmpv.so.1 (not 2) and that ldd on /var/lib/flatpak/app/io.kapsa.drive/...../extra/local/lib/s3drive/kapsa shows libmpv.so.2 => not found Have I done something wrong or is the package incorrect?
Hey, this is now fixed: https://github.com/flathub/io.kapsa.drive/pull/28 but changes on Flathub takes some time to propagate, so if the build time updates here: https://flathub.org/en-GB/apps/io.kapsa.drive to something more recent than on the attached image, then it means it ended up in the official release. If you're in hurry you can build the Flatpak yourself using: git clone --recursive git@github.com:flathub/io.kapsa.drive.git cd io.kapsa.drive flatpak-builder --user --install --force-clean build-dir io.kapsa.drive.json ... however it does require some prior environment setup, like: flatpak install flathub org.freedesktop.Sdk//23.08 flatpak install flathub org.freedesktop.Platform flatpak install org.freedesktop.Sdk.Extension.vala/x86_64/23.08 We will be providing full guide, "how to compile Flatpak". (edited)
Avatar
Avatar
Tom
Hey, this is now fixed: https://github.com/flathub/io.kapsa.drive/pull/28 but changes on Flathub takes some time to propagate, so if the build time updates here: https://flathub.org/en-GB/apps/io.kapsa.drive to something more recent than on the attached image, then it means it ended up in the official release. If you're in hurry you can build the Flatpak yourself using: git clone --recursive git@github.com:flathub/io.kapsa.drive.git cd io.kapsa.drive flatpak-builder --user --install --force-clean build-dir io.kapsa.drive.json ... however it does require some prior environment setup, like: flatpak install flathub org.freedesktop.Sdk//23.08 flatpak install flathub org.freedesktop.Platform flatpak install org.freedesktop.Sdk.Extension.vala/x86_64/23.08 We will be providing full guide, "how to compile Flatpak". (edited)
It is now live on Flathub.
Skelhost joined the server. 1/30/2024 12:57 AM
Đunk joined the server. 1/30/2024 2:13 AM
Avatar
Avatar
Tom
It is now live on Flathub.
Great - reinstalled & it's starting now. Thanks a lot.
👍 1
Søren joined the server. 1/31/2024 4:27 PM
Jamie joined the server. 1/31/2024 7:11 PM
mblerandd joined the server. 1/31/2024 8:14 PM
Cliff joined the server. 1/31/2024 9:14 PM
Avatar
Hi Newcomers 👋 !
s3drive 1
thG joined the server. 2/1/2024 2:38 AM
luis joined the server. 2/1/2024 1:42 PM
DetoxBKG joined the server. 2/1/2024 8:11 PM
drml joined the server. 2/2/2024 1:29 PM
JesseDS joined the server. 2/5/2024 3:04 AM
nez joined the server. 2/5/2024 5:16 PM
NezorF joined the server. 2/5/2024 5:19 PM
Deleted User joined the server. 2/8/2024 8:58 PM
GigaUpdate joined the server. 2/9/2024 2:49 AM
ezerez joined the server. 2/9/2024 11:46 AM
jairoefe joined the server. 2/9/2024 5:06 PM
jesdav joined the server. 2/10/2024 2:36 PM
Denis joined the server. 2/11/2024 2:00 AM
Jack joined the server. 2/11/2024 3:42 AM
t joined the server. 2/11/2024 12:39 PM
Deleted User joined the server. 2/11/2024 12:54 PM
xpresso joined the server. 2/11/2024 8:20 PM
Nitrotoluol joined the server. 2/12/2024 3:06 PM
Mirsad1 joined the server. 2/12/2024 10:41 PM
cowduck joined the server. 2/13/2024 2:14 AM
SalCif joined the server. 2/13/2024 1:22 PM
Avatar
Hello teams, just want to report, yesterday i'm trying to run S3Drive AppImage on Fedora (Xfce), but after double click, nothing happened (app not open). Today I try to run S3Drive Deb & AppImage on Debian 12.5 (Xfce), the result same as yesterday...
Avatar
Avatar
Bryan
Hello teams, just want to report, yesterday i'm trying to run S3Drive AppImage on Fedora (Xfce), but after double click, nothing happened (app not open). Today I try to run S3Drive Deb & AppImage on Debian 12.5 (Xfce), the result same as yesterday...
When you start AppImage, do you get anything in logs, e.g. : ./S3Drive-x86_64.AppImage (kapsa:2730352): Gdk-CRITICAL **: 09:39:57.636: gdk_window_get_state: assertion 'GDK_IS_WINDOW (window)' failed package:media_kit_libs_linux registered. flutter: *** sqflite warning *** You are changing sqflite default factory. Be aware of the potential side effects. Any library using sqflite will have this factory as the default for all operations. *** sqflite warning *** method call InitAppWindow method call InitSystemTray SystemTray::set_system_tray_info title: (null), icon_path: /tmp/.mount_S3DrivJ2GgY2/data/flutter_assets/assets/logos/logo_42.png, toolTip: (null) method call CreateContextMenu value_to_menu_item type:label, label:Show value_to_menu_item type:label, label:Hide value_to_menu_item type:label, label:Start drive mount value_to_menu_item type:label, label:Stop drive mount value_to_menu_item type:label, label:Start WebDav value_to_menu_item type:label, label:Stop WebDav value_to_menu_item type:label, label:Support value_to_menu_item type:label, label:Visit Website value_to_menu_item type:label, label:About value_to_menu_item type:label, label:Changelog value_to_menu_item type:label, label:Logs value_to_menu_item type:label, label:Version 1.7.11 method call SetContextMenu Just a question, did you try running Flatpak format? https://github.com/flathub/io.kapsa.drive/
Contribute to flathub/io.kapsa.drive development by creating an account on GitHub.
Avatar
Avatar
Tom
When you start AppImage, do you get anything in logs, e.g. : ./S3Drive-x86_64.AppImage (kapsa:2730352): Gdk-CRITICAL **: 09:39:57.636: gdk_window_get_state: assertion 'GDK_IS_WINDOW (window)' failed package:media_kit_libs_linux registered. flutter: *** sqflite warning *** You are changing sqflite default factory. Be aware of the potential side effects. Any library using sqflite will have this factory as the default for all operations. *** sqflite warning *** method call InitAppWindow method call InitSystemTray SystemTray::set_system_tray_info title: (null), icon_path: /tmp/.mount_S3DrivJ2GgY2/data/flutter_assets/assets/logos/logo_42.png, toolTip: (null) method call CreateContextMenu value_to_menu_item type:label, label:Show value_to_menu_item type:label, label:Hide value_to_menu_item type:label, label:Start drive mount value_to_menu_item type:label, label:Stop drive mount value_to_menu_item type:label, label:Start WebDav value_to_menu_item type:label, label:Stop WebDav value_to_menu_item type:label, label:Support value_to_menu_item type:label, label:Visit Website value_to_menu_item type:label, label:About value_to_menu_item type:label, label:Changelog value_to_menu_item type:label, label:Logs value_to_menu_item type:label, label:Version 1.7.11 method call SetContextMenu Just a question, did you try running Flatpak format? https://github.com/flathub/io.kapsa.drive/
the app not open after i click execute, both appimage and deb version (edited)
Avatar
Avatar
Bryan
the app not open after i click execute, both appimage and deb version (edited)
By any chance, can you start from command line?
satvika joined the server. 2/16/2024 8:01 AM
Avatar
Avatar
Tom
By any chance, can you start from command line?
doomblah joined the server. 2/16/2024 9:23 PM
Aristorn joined the server. 2/18/2024 10:44 PM
sitenevnews joined the server. 2/19/2024 10:42 AM
Avatar
A very interesting program, thanks to the developers. I want to buy the lifetime version. Are there any promotions or discounts planned using promotional codes? And another question: will the program be translated into other languages?
Avatar
Avatar
Nitrotoluol
A very interesting program, thanks to the developers. I want to buy the lifetime version. Are there any promotions or discounts planned using promotional codes? And another question: will the program be translated into other languages?
Thanks for the good words ! We did have a pretty good Black Friday, however since we've added Rclone support end of December we plan to increase the price slightly, yet it's still possible to get the Lifetime before the price hike. We do have plans to translate it to other languages, however we haven't got to that just yet: https://s3drive.canny.io/feature-requests/p/translate-the-app-extract-translation-strings and given our ambitious roadmap: https://s3drive.app/roadmap2024 at best we may translate app only partially by the end of 2024.
info@mealbox.it joined the server. 2/19/2024 3:07 PM
Avatar
info@mealbox.it 2/19/2024 4:18 PM
good afternoon
👋 1
Avatar
Avatar
info@mealbox.it
good afternoon
Buonasera !
Avatar
Avatar
Tom
Thanks for the good words ! We did have a pretty good Black Friday, however since we've added Rclone support end of December we plan to increase the price slightly, yet it's still possible to get the Lifetime before the price hike. We do have plans to translate it to other languages, however we haven't got to that just yet: https://s3drive.canny.io/feature-requests/p/translate-the-app-extract-translation-strings and given our ambitious roadmap: https://s3drive.app/roadmap2024 at best we may translate app only partially by the end of 2024.
Greetings! Thank you very much for your quick response! I continue to study and test the capabilities of the application and have encountered the following problem: I want to synchronize media files with Backblaze storage, but it is important that the original file creation date is preserved when saving/restoring files from the storage to the device (since files in the gallery are sorted by creation date and if Do not restore the file creation date, then there will be chaos in the gallery). Is it possible to save/restore the creation or modification date of original files during synchronization?
Avatar
Avatar
Nitrotoluol
Greetings! Thank you very much for your quick response! I continue to study and test the capabilities of the application and have encountered the following problem: I want to synchronize media files with Backblaze storage, but it is important that the original file creation date is preserved when saving/restoring files from the storage to the device (since files in the gallery are sorted by creation date and if Do not restore the file creation date, then there will be chaos in the gallery). Is it possible to save/restore the creation or modification date of original files during synchronization?
Can you please let me know what platform you use and whether you use Media Backup (mobile) or Sync (all platforms)? Modification date shall be preserved, we've added this in a : "[1.7.1] - 2024-01-04" release (https://s3drive.app/changelog). Creation date is trickier to implement reliably given that not all filesystems support it on platforms that we support and underlying Rclone library that we use for syncing doesn't use creation dates either. We will certainly think of implementing creation date, especially for macOS and Windows platform, or Unix the answer isn't simple.
Avatar
Avatar
Tom
Can you please let me know what platform you use and whether you use Media Backup (mobile) or Sync (all platforms)? Modification date shall be preserved, we've added this in a : "[1.7.1] - 2024-01-04" release (https://s3drive.app/changelog). Creation date is trickier to implement reliably given that not all filesystems support it on platforms that we support and underlying Rclone library that we use for syncing doesn't use creation dates either. We will certainly think of implementing creation date, especially for macOS and Windows platform, or Unix the answer isn't simple.
I use S3Drive 1.7.10 on a phone with Android 12. I created a synchronization task for a folder on the phone (sending from the phone to Baskblaze), "Sync" synchronization mode. The "modification date" is not saved and cannot be restored.
Mikel joined the server. 2/20/2024 4:38 PM
Deleted User joined the server. 2/20/2024 9:06 PM
cojonees. joined the server. 2/20/2024 9:22 PM
Avatar
Hey guys, I wanted to ask if I got a ultimate license for my andriod if I can use the MacOS app to download files with it. The reason I ask is because when I try to download a zip on the app it says I need a ultimate license but I know I bought one in Google Play
Avatar
Hi - I'm coming from S3 Browser and they have an option to use a custom domain name that replaces the s3 url. See Attachment. I read somewhere this was planned for S3Drive. Is this still the case? Or is it already implemented and I cant find it in the app. Thanks for your time.
Avatar
Avatar
/Chris
Hi - I'm coming from S3 Browser and they have an option to use a custom domain name that replaces the s3 url. See Attachment. I read somewhere this was planned for S3Drive. Is this still the case? Or is it already implemented and I cant find it in the app. Thanks for your time.
Something similar was requested along the lines: https://s3drive.canny.io/feature-requests/p/allow-custom-download-url and https://s3drive.canny.io/feature-requests/p/allow-sharing-raw-unsigned-urls Sounds like we may have to prioritize it. Quick question, what's the use case for: "Custom host name" for you? Would that be, so in the shared URLs you have shorter name? What's the list of URLs on your screen? Can you connect to your bucket using your "Custom host name"? In which case you could pass it as a Gateway during login screen.
penguinfai joined the server. 2/21/2024 8:57 AM
triggy joined the server. 2/21/2024 9:13 PM
Avatar
sup chads
👋 1
Avatar
How many gb you are offering on lifetime plan for 50 dolar
Mixih joined the server. 2/21/2024 11:24 PM
Avatar
Hi, I'm getting a "Error: Exception: corrupted on transfer: md5 encrypted hash differ" on a one-way copy-mode sync (local->remote) to an encrypted vault in a S3 bucket (versioning on, object lock off) in IDrive E2 on android and Linux. Any idea how to fix this? Thanks! (edited)
Avatar
Avatar
Tom
Something similar was requested along the lines: https://s3drive.canny.io/feature-requests/p/allow-custom-download-url and https://s3drive.canny.io/feature-requests/p/allow-sharing-raw-unsigned-urls Sounds like we may have to prioritize it. Quick question, what's the use case for: "Custom host name" for you? Would that be, so in the shared URLs you have shorter name? What's the list of URLs on your screen? Can you connect to your bucket using your "Custom host name"? In which case you could pass it as a Gateway during login screen.
Thanks for your time. - what's the use case for: "Custom host name" for you? We use our buckets to provide downloads of our assets for our customers. Videos and photos (Video production company) We use iDRIVE with multiple regions. All I'm looking to do is mask the domain name with our domain name. Everything else stays the same. I'm only using S3 APP to upload to our bucket and grab the original link from iDrice to give to the cutomer to download. Example S3 link from iDrive: dfgd1fg45d.la.idrive2-57.com/filname-123.zip When we convert to our own domain it looks like this: http:// la.domainname.com/filname-123.zip Would that be, so in the shared URLs you have a shorter name? Yes - It also looks legitimate from our domain name. Also when i Drive uses the cNAME domain name, the original idrive url is hidden. (And no one knows the actual bucket link) What's the list of URLs on your screen? All S3 browser does is mask the original link. The screenshot shows the original link, however, if you type your own domain name into the custom domain host name, those links will change from amazonaws.com to your domain name. That's all it does. Can you connect to your bucket using your "Custom host name"? Yes - because we already have a CNAME for the domain example: cdn.domainname.com configured. idrive guide here but I'm assuming others have a similar solution to cname: https://www.idrive.com/s3-storage-e2/cname-guide
Use your own domain name with IDrive® e2. Add and manage a CNAME record.
Avatar
Avatar
/Chris
Thanks for your time. - what's the use case for: "Custom host name" for you? We use our buckets to provide downloads of our assets for our customers. Videos and photos (Video production company) We use iDRIVE with multiple regions. All I'm looking to do is mask the domain name with our domain name. Everything else stays the same. I'm only using S3 APP to upload to our bucket and grab the original link from iDrice to give to the cutomer to download. Example S3 link from iDrive: dfgd1fg45d.la.idrive2-57.com/filname-123.zip When we convert to our own domain it looks like this: http:// la.domainname.com/filname-123.zip Would that be, so in the shared URLs you have a shorter name? Yes - It also looks legitimate from our domain name. Also when i Drive uses the cNAME domain name, the original idrive url is hidden. (And no one knows the actual bucket link) What's the list of URLs on your screen? All S3 browser does is mask the original link. The screenshot shows the original link, however, if you type your own domain name into the custom domain host name, those links will change from amazonaws.com to your domain name. That's all it does. Can you connect to your bucket using your "Custom host name"? Yes - because we already have a CNAME for the domain example: cdn.domainname.com configured. idrive guide here but I'm assuming others have a similar solution to cname: https://www.idrive.com/s3-storage-e2/cname-guide
Thanks for your detailed feedback, I can confirm that we'll be adding this feature. Hard to give any ETA, but next month certainly possible. (edited)
😍 1
Avatar
Avatar
Tom
Thanks for your detailed feedback, I can confirm that we'll be adding this feature. Hard to give any ETA, but next month certainly possible. (edited)
Cheers Tom - Appreciate it - Thanks for your time.
Memger joined the server. 2/22/2024 2:51 PM
#!/bin/bash joined the server. 2/22/2024 6:25 PM
Avatar
Avatar
#!/bin/bash
Click to see original message
Avatar
Avatar
/Chris
Cheers Tom - Appreciate it - Thanks for your time.
Hi @/Chris, we've got preview of this feature deployed to our web client. There are two options, one to not create a signature, the other one is to set custom domain. Once custom domain is set once, this setting will be preserved for this bucket. Please let me know whether this works for you and if you have any thoughts, then we can apply tweaks and include it in next release to other platforms. cc @Xenthys Hi there, correct me if I'm wrong, but haven't you requested similar feature in the past?
😍 1
Avatar
Yes, you may want to note that unsigned URLs don't have an expiration since it's linked to the signature, I don't know if it's possible to make the UI actually show that to the end user
Avatar
Avatar
Xenthys
Yes, you may want to note that unsigned URLs don't have an expiration since it's linked to the signature, I don't know if it's possible to make the UI actually show that to the end user
Good call, we'll replace the Link expiration with a warning once Unsigned URL option is selected.
Avatar
Otherwise good thanks, raw presigned + unsigned was indeed what I'm after!
Avatar
Avatar
Tom
Hi @/Chris, we've got preview of this feature deployed to our web client. There are two options, one to not create a signature, the other one is to set custom domain. Once custom domain is set once, this setting will be preserved for this bucket. Please let me know whether this works for you and if you have any thoughts, then we can apply tweaks and include it in next release to other platforms. cc @Xenthys Hi there, correct me if I'm wrong, but haven't you requested similar feature in the past?
Perfect! I just tested the unsigned url with a custom domain. That is exactly what I was looking for. Thank you!
11:30 PM
me haves questions
11:30 PM
well
11:31 PM
one really
11:31 PM
so do I need to enable "end to end" encryption to make my data transferred securely
11:32 PM
or am i stupid and its already encrypted when transmitted or something
Avatar
by default it's transmitted over HTTPS, so it's secure
Avatar
ok swag just making sure
11:36 PM
https my beloved
Avatar
end-to-end is when you don't trust the host, aka. it's encrypted and decrypted on the client
Avatar
i was confused if i was gonna have to enable https myself lol
Avatar
there was a lame joke here, too lame to stay (edited)
Avatar
Avatar
Xenthys
there was a lame joke here, too lame to stay (edited)
another question
11:42 PM
if i select to auto backup recent which contains everything would it back all of the seperate folders or combine it into one giant glob
Avatar
that's a good question, I don't have the answer sorry, maybe @Tom will
Avatar
this app is swag
Avatar
@Tom tom do u kno
Avatar
omg hi dunk
Avatar
@triggy from what I can see everything is uploaded into the same folder, also hi
1:27 AM
Lemme see if just selecting recent will actually capture most folders properly or if it'll be unreliable
1:30 AM
Seems to successfully grab everything, though again it's all just placed in the root of the backup location instead of being organised the same as it would be locally
Avatar
Avatar
Đunk
Seems to successfully grab everything, though again it's all just placed in the root of the backup location instead of being organised the same as it would be locally
ah so you're saying it doesn't keep the subfolders and shit organized
Avatar
Yeah, sadly no subfolders, though since it's early days it may get added
Lomsor joined the server. 2/23/2024 4:16 AM
Avatar
Hey Everyone. Been researching for days for ways to make S3 storage somewhat usable and still secure as well as looking into alternatives to S3 altogether but nothing came close to the requirements ... What I am missing is Mobile and and SSO on Mobile. I saw there has been talk about it a while back as well as some vague mentions on the website. I would be grateful to hear what the current status is on the matter of SSO in S3Drive (edited)
Avatar
Avatar
triggy
if i select to auto backup recent which contains everything would it back all of the seperate folders or combine it into one giant glob
oh noes i even did everything with individual albums and my b2 didnt seperate everything into seperate folders aaaaaah
12:46 PM
its so over
Avatar
Avatar
triggy
oh noes i even did everything with individual albums and my b2 didnt seperate everything into seperate folders aaaaaah
Hi @triggy, In a next couple months we plan to improve media backup tool, so it preserves the album names as folders. Current version was primarily focused on reliably backing up photos/videos (incl. background mode) and there aren't any additional photo management options. Stay tuned ! (edited)
cdprotector joined the server. 2/23/2024 2:01 PM
Avatar
Avatar
Tom
Hi @triggy, In a next couple months we plan to improve media backup tool, so it preserves the album names as folders. Current version was primarily focused on reliably backing up photos/videos (incl. background mode) and there aren't any additional photo management options. Stay tuned ! (edited)
tbh it's pretty great so far good job focusing on making things work first before adding 38261 features
👍 1
Avatar
Avatar
Lomsor
Hey Everyone. Been researching for days for ways to make S3 storage somewhat usable and still secure as well as looking into alternatives to S3 altogether but nothing came close to the requirements ... What I am missing is Mobile and and SSO on Mobile. I saw there has been talk about it a while back as well as some vague mentions on the website. I would be grateful to hear what the current status is on the matter of SSO in S3Drive (edited)
Hi @Lomsor, We haven't exactly started work on SSO. Would you be happy to tell me little more about your use case? We plan to execute work on SSO in a next couple months, although we don't have a clear designs just yet. In principle the idea is that you user will provide the SSO endpoint which after successfull auth could then inject S3 credentials (and custom config) into S3Drive and login user to the specified bucket. (edited)
Avatar
hi, I am testing available SW products for S3 storage /idrive e2/ direct mount to Linux/Mac/Win. For some strange reason Mountainduck is not working asking for Region server for every file/folder created on client OSs. So far only Expandrive is working. On reddit I get link to S3drive and now here I got problem: S3 connect is working, it mounts drive in Win/Linux but when I create folder/file in OS Explorer/Dolphin - the change does not amke into real S storage bucket. What I am doing wrong ?
2:07 PM
When I create file in S3drive app - change is immediately visible also in S3 bucket
Avatar
Tom will have to confirm, but mounts typically see a lot of file changes compared to individual uploads, it's probable files are flushed from time to time or on exit to reduce bucket operations costs
Avatar
I tested to manualy invoke SYNC from Local to Remote to get changes "applied" but that does not take OS mounted drive changes into account. maybe I am understanding S3drive functionality wrong ? I wanted to have just mounted S3 bucket to local PC/notebooks the same way as Mapped drives in Windows.
2:17 PM
I am open to pay for such functionality if it requires Ultimate account
Avatar
Not sure about anything in the current state as I only use the mobile app myself, it could also be an issue, I recomment posting in #support so Tom can handle it as soon as he's available, it'll end up there if it's a bug and will stay for future reference (edited)
Avatar
Thanks, will do more testing on mobile too
theOne joined the server. 2/23/2024 2:53 PM
Avatar
Avatar
Tom
Hi @Lomsor, We haven't exactly started work on SSO. Would you be happy to tell me little more about your use case? We plan to execute work on SSO in a next couple months, although we don't have a clear designs just yet. In principle the idea is that you user will provide the SSO endpoint which after successfull auth could then inject S3 credentials (and custom config) into S3Drive and login user to the specified bucket. (edited)
Thanks for the update Tom. TLDR: We would like to use the temporary credentials generated trough "IAM Identity Center" or "AWS CLI Login" to access and mount S3 Buckets in S3Drive. If I interpret your plan correctly this sounds like what I am looking for. rclone seems to support this type of authentication (https://rclone.org/s3/#authentication) trough I don't see a (non headache inducing) way for me to get the credentials to rclone on mobile and I would like to have minimal setup for future users. We are using AWS best practices which state that the bucket shouldn't be publicly accessible and that there shouldn't be any long term credentials for it. This means no IAM Users with permanent access to resources like S3, instead IAM roles should be assumed trough IAM Identity center (SSO). Which generates temporary credentials with three elements with one of them being a time limited token. I would like to have all business applications be reachable trough SSO, either SAML2 or OAuth2. There are a couple of desktop apps for S3 that can work with temporary credentials but none for mobile. Currently on desktop it works like this: either the application or some script triggers "aws login" with the aws profile being preconfigured once beforehand. A browser opens and the user approves or logs in (password, MFA, etc.), then the three element credentials are generated (access key id, secret access key, session token) and saved in a credentials file and/or the environment variables. Then the app either looks at the environment or directly at the file and uses these credentials for access to S3. Ideally the token would be refreshed before it expires. (edited)
Avatar
Avatar
cdprotector
hi, I am testing available SW products for S3 storage /idrive e2/ direct mount to Linux/Mac/Win. For some strange reason Mountainduck is not working asking for Region server for every file/folder created on client OSs. So far only Expandrive is working. On reddit I get link to S3drive and now here I got problem: S3 connect is working, it mounts drive in Win/Linux but when I create folder/file in OS Explorer/Dolphin - the change does not amke into real S storage bucket. What I am doing wrong ?
On what OS you find this behavior? Can you please make sure that your: "Mount cache mode" is set to "Minimal"? This shall skip the Rclone VFS cache and make operations blocking until they end up on S3.
Avatar
Avatar
cdprotector
I tested to manualy invoke SYNC from Local to Remote to get changes "applied" but that does not take OS mounted drive changes into account. maybe I am understanding S3drive functionality wrong ? I wanted to have just mounted S3 bucket to local PC/notebooks the same way as Mapped drives in Windows.
Hi, can you please create #support item? In principle sync and mount maybe used for similar purposes, but they are fundamentally different. You would usually use mount if you want to interact with remote file system directly. If you need "blocking" behaviour, please set cache mode to Minimal (In the Settings). If you want to work as if it was "local" path, which will be eventually consistent on the remote side (once Rclone finalizes the upload), then use "Writes" or even "Full" cache - the issue with these cache modes is that there is no clear indication if process to copy changes to remote has finished. Another issue with mount cache is that your directory listing might be stale, especially if there is other user or process which modified changes remotely (S3) without your knowledge. You would usually use sync if you want to work locally and flush changes automatically (with file watchers) and periodically (with the timer set in the settings).
Avatar
Avatar
Lomsor
Thanks for the update Tom. TLDR: We would like to use the temporary credentials generated trough "IAM Identity Center" or "AWS CLI Login" to access and mount S3 Buckets in S3Drive. If I interpret your plan correctly this sounds like what I am looking for. rclone seems to support this type of authentication (https://rclone.org/s3/#authentication) trough I don't see a (non headache inducing) way for me to get the credentials to rclone on mobile and I would like to have minimal setup for future users. We are using AWS best practices which state that the bucket shouldn't be publicly accessible and that there shouldn't be any long term credentials for it. This means no IAM Users with permanent access to resources like S3, instead IAM roles should be assumed trough IAM Identity center (SSO). Which generates temporary credentials with three elements with one of them being a time limited token. I would like to have all business applications be reachable trough SSO, either SAML2 or OAuth2. There are a couple of desktop apps for S3 that can work with temporary credentials but none for mobile. Currently on desktop it works like this: either the application or some script triggers "aws login" with the aws profile being preconfigured once beforehand. A browser opens and the user approves or logs in (password, MFA, etc.), then the three element credentials are generated (access key id, secret access key, session token) and saved in a credentials file and/or the environment variables. Then the app either looks at the environment or directly at the file and uses these credentials for access to S3. Ideally the token would be refreshed before it expires. (edited)
I will get back to you on that once I manage to try out couple things with our team. We would be really keen to push some SSO workflow forward. Speaking of desktop apps that you've used and worked for your use case, do you happen to recommend any of them? I would be happy to test that workflow personally and see if that's something we would be willing to incorporate in S3Drive.
Avatar
i have a lot of work ahead of me lol
NezorF joined the server. 2/23/2024 9:21 PM
Avatar
Avatar
Tom
I will get back to you on that once I manage to try out couple things with our team. We would be really keen to push some SSO workflow forward. Speaking of desktop apps that you've used and worked for your use case, do you happen to recommend any of them? I would be happy to test that workflow personally and see if that's something we would be willing to incorporate in S3Drive.
Thanks! Back when I first set this up I didn't find many so I went with a tool called 'TntDrive'. It does work but I wouldn't recommend it. For my use case I had to write a script that injects the credentials into the environment, the tool was able to be set to read from them. It also required to be elevated. S3Browser from the same devs has an integrated authentication solution that works with SSO, I asked them why it wasn't in TntDrive and they said that the focus there was to be a service without requiring user interaction. In my recent research I came across a few more that seem a bit more streamlined. Cyberduck and Mountain Duck seems alright. I know they can do SSO but don't know if they also require an external script. I was on the lookout for mobile so didn't try anything new that didn't at least have support for Mobile OS.
Alex joined the server. 2/24/2024 9:57 AM
Marmotte73 joined the server. 2/24/2024 5:18 PM
marmotte73 joined the server. 2/24/2024 5:20 PM
//◭// ヨフォシ– ∞WAVE joined the server. 2/25/2024 4:53 PM
HumanGPT joined the server. 2/25/2024 7:17 PM
mcosby joined the server. 2/27/2024 1:47 AM
Avatar
There are two options for backing up folders with media files, the first is using the "Media backup" mechanism, the second is simply adding the necessary folders to synchronization jobs with the "Sync" mode. I have a question. What is the difference between "Media backup mode" and folder synchronization in "Sync" mode? What are the pros and cons?
Avatar
Hello team, I don't have much of a technical background but I have managed to connect my s3 storage (free backblaze for now) to s3drive. Thanks for your instructions in the docs 😊 I would like to buy the lifetime offer, but I have one question first. Is my s3 storage automatically e2e encrypted after the purchase? Or do I have to do something technical? I mainly want to use S3Drive as a drive mount under windows and also be able to access the storage via your app on my smartphone. And the entire cloud should of course be encrypted.
Avatar
Avatar
ReplaX
Hello team, I don't have much of a technical background but I have managed to connect my s3 storage (free backblaze for now) to s3drive. Thanks for your instructions in the docs 😊 I would like to buy the lifetime offer, but I have one question first. Is my s3 storage automatically e2e encrypted after the purchase? Or do I have to do something technical? I mainly want to use S3Drive as a drive mount under windows and also be able to access the storage via your app on my smartphone. And the entire cloud should of course be encrypted.
Thanks for you message. In order to use E2E you will need to set it up on your devices using same passphrase. You can enable it in the settings and once it's set up, an indicator on the Files screen (lock icon) will appear. (edited)
👍🏻 1
Avatar
Avatar
Nitrotoluol
There are two options for backing up folders with media files, the first is using the "Media backup" mechanism, the second is simply adding the necessary folders to synchronization jobs with the "Sync" mode. I have a question. What is the difference between "Media backup mode" and folder synchronization in "Sync" mode? What are the pros and cons?
Media backup mode is tightly integrated with the Android/iOS ecosystem, it allows you to select specific albums, supports background backup (on Android photo is uploaded almost instantly), displays statistics, has wifi/charger/low battery constraints etc. Sync is "just" an operation of files and folders powered by Rclone library. It's not aware of the underlying platform. It needs raw file system to work. Mobile OS's doesn't easily expose raw file system. We've managed to get accepted on Google recently, but on iOS that's not possible, so media backup is the only option. Since it's a new feature it doesn't yet support background backup or upload constraints. Feel free to try both and decide which works for you better. (edited)
Nanosonde joined the server. 2/28/2024 5:26 PM
Avatar
S3drive completely freezes on MacOS and I have to force quit it.
Avatar
Avatar
Alex
S3drive completely freezes on MacOS and I have to force quit it.
Thank you for your report. Are you using mount feature? If so, what are your settings are you using FUSE mount (recommended) or NFS (experimental)? App freezes during normal quite when NFS mount is used, we're looking to fix that. Can you please let me know if possible under what conditions the app freezes, is it when you upload multiple files/folders, sync folders etc.?
Noko joined the server. 2/29/2024 4:35 AM
Zwani joined the server. 2/29/2024 12:46 PM
Avatar
Avatar
Tom
Thank you for your report. Are you using mount feature? If so, what are your settings are you using FUSE mount (recommended) or NFS (experimental)? App freezes during normal quite when NFS mount is used, we're looking to fix that. Can you please let me know if possible under what conditions the app freezes, is it when you upload multiple files/folders, sync folders etc.?
I initially did try mount, but I disabled it and still the S3drive app freezes. I'm on M3.
Avatar
Avatar
Alex
I initially did try mount, but I disabled it and still the S3drive app freezes. I'm on M3.
Does it freeze immediately after app starts or at some point during run? Do you have any sync settings? Can you verify whether you don't have mount autostart setting enabled - in that case mount would start even if you don't use it causing potentially app freeze during quit.
therealmutlusen joined the server. 2/29/2024 8:31 PM
Avatar
Avatar
therealmutlusen
Click to see original message
therealmutlusen 2/29/2024 8:31 PM
Avatar
Avatar
Tom
Thanks for you message. In order to use E2E you will need to set it up on your devices using same passphrase. You can enable it in the settings and once it's set up, an indicator on the Files screen (lock icon) will appear. (edited)
Bought lifetime yesterday and activated e2ee at my storage 👍🏻 Were files that were uploaded before the e2ee was activated now subsequently encrypted? Or are they still unencrypted? If so, how can I see whether a file is encrypted or not?
👍 1
Avatar
Avatar
ReplaX
Bought lifetime yesterday and activated e2ee at my storage 👍🏻 Were files that were uploaded before the e2ee was activated now subsequently encrypted? Or are they still unencrypted? If so, how can I see whether a file is encrypted or not?
Thank you for your purchase. After enabling E2E only newly uploaded files will be encrypted. In order to encrypt existing files you would have to download them and then reupload. We haven't exactly provided a clear workflow, but I would suggest downloading all your data from the bucket using Rclone and then reuploading them to a different bucket where encryption is enabled. You can do so from the app itself using Sync functionality (we're using Rclone internally). You could set up two buckets in S3Drive, one source bucket (your existing) with encryption disabled and one destination bucket with encryption enabled and then set up Remote -> Remote sync. There isn't convenient way to tell if file is encrypted or not, because in order to get that information file would have to be queried individually to check the content, but there are two things that can be observed. 1) File which content is encrypted is 32 bytes bigger. 2) If file has filename encrypted, than after disabling filename encryption in S3Drive you can see its name turning into some random looking characters. If you've had both content/filename encryption enabled than you could technically use these two indicators to determine if a single file was encrypted or not... but a fool proof way for multiple ways is to reupload it altogether. We'll be providing more detailed and tested workflow how to migrate data. In the meantime I would be keen to know if you manage to reencrypt your data. It's not recommended to mix encrypted data with not encrypted data within same bucket. S3Drive can deal with it, however internal tools that we're integrated with are more strict.... so for instance if you enable E2E and use drive mount, your unencrypted data won't be listed in your virtual drive... despite that they're shown by S3Drive. (edited)
😯 1
Avatar
Man, it's been a while since I've said it but I love S3Drive. You really handled the raw signed / unsigned URLs well.
❤️ 3
Avatar
Avatar
Tom
Thank you for your purchase. After enabling E2E only newly uploaded files will be encrypted. In order to encrypt existing files you would have to download them and then reupload. We haven't exactly provided a clear workflow, but I would suggest downloading all your data from the bucket using Rclone and then reuploading them to a different bucket where encryption is enabled. You can do so from the app itself using Sync functionality (we're using Rclone internally). You could set up two buckets in S3Drive, one source bucket (your existing) with encryption disabled and one destination bucket with encryption enabled and then set up Remote -> Remote sync. There isn't convenient way to tell if file is encrypted or not, because in order to get that information file would have to be queried individually to check the content, but there are two things that can be observed. 1) File which content is encrypted is 32 bytes bigger. 2) If file has filename encrypted, than after disabling filename encryption in S3Drive you can see its name turning into some random looking characters. If you've had both content/filename encryption enabled than you could technically use these two indicators to determine if a single file was encrypted or not... but a fool proof way for multiple ways is to reupload it altogether. We'll be providing more detailed and tested workflow how to migrate data. In the meantime I would be keen to know if you manage to reencrypt your data. It's not recommended to mix encrypted data with not encrypted data within same bucket. S3Drive can deal with it, however internal tools that we're integrated with are more strict.... so for instance if you enable E2E and use drive mount, your unencrypted data won't be listed in your virtual drive... despite that they're shown by S3Drive. (edited)
I have to test that, also the mount drive. Will setup it this weekend 😊
3:17 PM
Thank you for your support 😊
Avatar
Are there any plans to support iOS shortcuts/automation functionality?
10:05 PM
Didn’t see anything in the roadmap, so I thought I’d ask.
Avatar
Avatar
Noko
Are there any plans to support iOS shortcuts/automation functionality?
We haven't planned anything around iOS shortcuts/automation just yet. Can you tell us little bit more how would you want to use this all together? We'll certainly add a feature request: https://s3drive.canny.io/feature-requests and based on the couple factors execute sooner or later. (edited)
Avatar
Mostly just want to add your app to existing shortcuts I have for processing and uploading files via the share sheet
9:01 AM
Another app that has this functionality exists but it only does S3, or ftp, and it’s via separate apps, I like how yours has it all in one
9:01 AM
Dunno if I’m allowed to link to a “competitor” app but here’s the one I mean if you want to see: https://apps.apple.com/us/app/s3-files-bucket-storage/id6447647340 If you don’t want the link feel free to delete my message.
Avatar
Avatar
Tom
We haven't planned anything around iOS shortcuts/automation just yet. Can you tell us little bit more how would you want to use this all together? We'll certainly add a feature request: https://s3drive.canny.io/feature-requests and based on the couple factors execute sooner or later. (edited)
Thanks for responding, it’s not a big urgent need for me or anything, I’d just appreciate if it’s on the radar at all :)
Avatar
Avatar
Noko
Thanks for responding, it’s not a big urgent need for me or anything, I’d just appreciate if it’s on the radar at all :)
Thank you for taking time to request new feature. I need to say I am personally quite new to the iOS world and haven't used shortcuts myself, I am going to research and play with this little more. We'll certainly have it implemented, it's just hard to tell at this stage when exactly, given lots of other features we try to squeeze in. Link to other app is fine, it serves here as an example. Thanks !
Avatar
It’s understandable if it’s a low priority item anyway, I initially found your app while looking for something specifically for iOS and only later realized your app is cross platform
rizom joined the server. 3/2/2024 9:47 AM
Felix250490 joined the server. 3/3/2024 10:03 AM
Avatar
Avatar
Felix250490
Click to see original message
Motorolo joined the server. 3/3/2024 12:01 PM
Deleted User joined the server. 3/4/2024 2:09 AM
Avatar
hello, just want to ask. if we buy ultimate packages on web, will it be automatically detected in the S3Drive Android application that we have made a purchase? a little confused by the words "all platforms".
Avatar
Avatar
Bryan
hello, just want to ask. if we buy ultimate packages on web, will it be automatically detected in the S3Drive Android application that we have made a purchase? a little confused by the words "all platforms".
Hi there, once you buy through our website you can then use Ultimate features on all your devices / all platforms as long as you're logged in using e-mail/password account that made the purchase. If you buy through in-app purchase, then you can use it on all your devices (only on specific platform Android or Apple), as long as your devices are using the same Google / Apple account that made the purchase. (edited)
Avatar
Avatar
Tom
Hi there, once you buy through our website you can then use Ultimate features on all your devices / all platforms as long as you're logged in using e-mail/password account that made the purchase. If you buy through in-app purchase, then you can use it on all your devices (only on specific platform Android or Apple), as long as your devices are using the same Google / Apple account that made the purchase. (edited)
12:31 AM
if i buy with my Gmail in website, Is it only my Gmail account that can enjoy all the features, or can my other S3 accounts enjoy it too? (edited)
12:33 AM
just report that S3Drive welcome email showing plain code like this
JazzySnazzyBen joined the server. 3/6/2024 3:19 AM
Avatar
Avatar
Bryan
if i buy with my Gmail in website, Is it only my Gmail account that can enjoy all the features, or can my other S3 accounts enjoy it too? (edited)
You will be able to use all the features including Multiple accounts. Your Gmail account here is only needed for licensing purposes.
Avatar
Avatar
Tom
You will be able to use all the features including Multiple accounts. Your Gmail account here is only needed for licensing purposes.
Get it. Thanks for explaining 🙏
Glaze joined the server. 3/6/2024 5:45 PM
Pewka91 joined the server. 3/6/2024 6:51 PM
Matt3o joined the server. 3/7/2024 12:34 PM
Mydsi joined the server. 3/7/2024 7:43 PM
Avatar
How much storage is there on the s3 drive account?
Avatar
Avatar
Mydsi
How much storage is there on the s3 drive account?
Thank you for buying the Ultimate license. You're looking at 10GB testing account regardless if you have Ultimate or Free license. You would normally use Ultimate plan together with an external account utilizing Ultimate features, including possibility of using multiple external accounts: https://docs.s3drive.app/plans/ In other words, Ultimate license is suited to be used with external account which you can add from the Profiles screen or login screen. Testing account that you're looking at, it's just to get the feel of the app. In the future it will be ready to be bought separately, as storage in nice packages (e.g. 100GB, 500GB, 2TB etc.), but it's not yet ready. (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Avatar
Tom
Thank you for buying the Ultimate license. You're looking at 10GB testing account regardless if you have Ultimate or Free license. You would normally use Ultimate plan together with an external account utilizing Ultimate features, including possibility of using multiple external accounts: https://docs.s3drive.app/plans/ In other words, Ultimate license is suited to be used with external account which you can add from the Profiles screen or login screen. Testing account that you're looking at, it's just to get the feel of the app. In the future it will be ready to be bought separately, as storage in nice packages (e.g. 100GB, 500GB, 2TB etc.), but it's not yet ready. (edited)
Thanks for the response:) In regards to entreprise solutions what are the price range?
Avatar
Avatar
Mydsi
How much storage is there on the s3 drive account?
You can find list of supported providers (including S3 clouds) here: https://docs.s3drive.app/setup/providers/ (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Avatar
Mydsi
Thanks for the response:) In regards to entreprise solutions what are the price range?
It really depends on your use case, level of customization and whether white-labeling / rebranding is needed. There are discounts for sustained use, number of licenses and upfront payments (yearly). We support couple different pricing models (per user or percentage fee of end price - for resell) which make sense for different use cases. Feel free to PM me, so I can better understand what you're looking for and guide you through what we can offer. (edited)
Deleted User joined the server. 3/8/2024 5:05 PM
Obeja joined the server. 3/9/2024 1:01 PM
bodega joined the server. 3/9/2024 10:37 PM
farmerjo joined the server. 3/9/2024 11:40 PM
Avatar
Avatar
farmerjo
Click to see original message
Sticker
Avatar
How often is the windows store version updated? Says last update was 1-12-2023, I personally would prefer installing through that method for the auto updates. But for now sticking with the regular exe since it has bug fixes for iDrive corruption so figured I'd not risk it yet. (edited)
Avatar
Avatar
Aristorn
How often is the windows store version updated? Says last update was 1-12-2023, I personally would prefer installing through that method for the auto updates. But for now sticking with the regular exe since it has bug fixes for iDrive corruption so figured I'd not risk it yet. (edited)
It's usually couple releases behind the .exe, however the date that you refer to is the initial release date, not the last update. https://apps.microsoft.com/detail/9nx2dn9q37ns?hl=en-gb I honestly don't know where Microsoft reports the current version, but I can confirm that we have actually 1.7.16 released, with the next release awaiting Microsoft approval.
👍 1
💟 1
h13ronim joined the server. 3/10/2024 9:43 PM
mix9311 joined the server. 3/10/2024 11:50 PM
AMZ-X joined the server. 3/11/2024 1:05 PM
artemisia joined the server. 3/11/2024 7:22 PM
Turner joined the server. 3/13/2024 3:49 AM
DRNI joined the server. 3/13/2024 9:21 AM
ai_potato joined the server. 3/13/2024 10:03 AM
slano joined the server. 3/13/2024 5:47 PM
Bernd joined the server. 3/14/2024 9:34 AM
Sleepy Dog🐶 joined the server. 3/15/2024 10:17 AM
balk joined the server. 3/16/2024 7:02 AM
Avatar
Hi, how can I upgrade from monthly to annual subscription?
Avatar
Avatar
balk
Hi, how can I upgrade from monthly to annual subscription?
You can either cancel your monthly subscription and then order a new one at the end of your purchased monthly plan. You can also cancel your monthly plan, order yearly immediately and then send us a quick message to support @ s3drive.app, so we can refund your unused monthly period or extend your annual plan using the unused monthly amount. (edited)
👍 1
yz joined the server. 3/17/2024 4:38 PM
Avatar
Hi! Nice app. 🙂 Where is the best place to ask a few questions or point out a few minor UX issues?
Avatar
Avatar
yz
Hi! Nice app. 🙂 Where is the best place to ask a few questions or point out a few minor UX issues?
Hi, you can ask here or create a #support item if you think that it may take a multiple iterations before we exhaust the topic. (edited)
Avatar
Question 1: I wanted to add a sync to a subpath of a Backblaze bucket - I haven't quite understood if that's possible. Then I found the Media backup tab which was the better fit for my use case to begin - so I don't need that feature atm. Just wanted to understand if it's possible at all
Avatar
Avatar
yz
Question 1: I wanted to add a sync to a subpath of a Backblaze bucket - I haven't quite understood if that's possible. Then I found the Media backup tab which was the better fit for my use case to begin - so I don't need that feature atm. Just wanted to understand if it's possible at all
Sync tool allows you to select specific folder on both local and remote side, however depending on platform it has certain limitations and doesn't support backgroun backup on mobile (media backup does support background operation). Do you refer to iOS or Android?
Avatar
Question 2: currently it's uploading a few GB of pictures and there are a few errors in my transfer tab (transient things like socket exploded, etc). If I click on re-upload it says it can't do that. So I am wondering if it will automatically retry the upload at some point?
Avatar
Avatar
Tom
Sync tool allows you to select specific folder on both local and remote side, however depending on platform it has certain limitations and doesn't support backgroun backup on mobile (media backup does support background operation). Do you refer to iOS or Android?
The Android app - and I haven't seen a way to select a subfolder
Avatar
Avatar
yz
Question 2: currently it's uploading a few GB of pictures and there are a few errors in my transfer tab (transient things like socket exploded, etc). If I click on re-upload it says it can't do that. So I am wondering if it will automatically retry the upload at some point?
The retry which doesn't work
Avatar
Avatar
yz
Question 2: currently it's uploading a few GB of pictures and there are a few errors in my transfer tab (transient things like socket exploded, etc). If I click on re-upload it says it can't do that. So I am wondering if it will automatically retry the upload at some point?
If there is an error during media upload, then media shouldn't be marked as uploaded, therefore it shall be picked up by the upload process during next iteration.
Avatar
Avatar
yz
Question 2: currently it's uploading a few GB of pictures and there are a few errors in my transfer tab (transient things like socket exploded, etc). If I click on re-upload it says it can't do that. So I am wondering if it will automatically retry the upload at some point?
I think that app can't restart failed upload that came from media backup tool, as there is some virtual file system involved. I need to double check that.
Avatar
Avatar
Tom
If there is an error during media upload, then media shouldn't be marked as uploaded, therefore it shall be picked up by the upload process during next iteration.
Cool!
5:09 PM
Question 3: the three dots don't do anything if no file is selected
Avatar
Avatar
Tom
I think that app can't restart failed upload that came from media backup tool, as there is some virtual file system involved. I need to double check that.
I actually don't care that much about being able to retry manually - it's more about communicating that everything is ok 🙂 (edited)
Avatar
Sorry, had to go away for a couple minutes. Getting back to your questions.
Avatar
Avatar
yz
The Android app - and I haven't seen a way to select a subfolder
You can select subfolder by either cling Remote or Local
Avatar
Avatar
Tom
Sorry, had to go away for a couple minutes. Getting back to your questions.
No worries, thanks for answering on a Sunday anyway - it's not time critical at all!
Avatar
Avatar
yz
The Android app - and I haven't seen a way to select a subfolder
Then you can select either remote path (screenshot attached) or local one (Android folder selector shall open).
Avatar
Avatar
yz
Question 3: the three dots don't do anything if no file is selected
That's a good point. It's an UI issue. Three dots shouldn't really appear if no file is selected as I understand. We will have it resolved in a next release. (edited)
Avatar
Avatar
Tom
Then you can select either remote path (screenshot attached) or local one (Android folder selector shall open).
Oh! I didn't notice the + that's exactly what I meant. I checked the documentation as well to see if it's possible at all. But yeah that's what i meant
Avatar
Avatar
yz
Oh! I didn't notice the + that's exactly what I meant. I checked the documentation as well to see if it's possible at all. But yeah that's what i meant
Yeah, it's pretty new stuff, released early this year and we haven't made any documentation just yet. We're still solving couple performance issues (especially on iOS), once we're done we'll create a nice guide detailing how to use it... it's rather powerful feature, since you can set multiple sync modes between local and remote or even between remotes. You can import files from other clouds or backup them. I guess that eventually we'll actually learn ourselves how users actually ab(use) that feature 🙂 (edited)
Avatar
Avatar
Tom
Yeah, it's pretty new stuff, released early this year and we haven't made any documentation just yet. We're still solving couple performance issues (especially on iOS), once we're done we'll create a nice guide detailing how to use it... it's rather powerful feature, since you can set multiple sync modes between local and remote or even between remotes. You can import files from other clouds or backup them. I guess that eventually we'll actually learn ourselves how users actually ab(use) that feature 🙂 (edited)
Fair enough and congrats on the new feature! I found my way around and set up everything as I wanted to. I just wanted to give some feedback about a few minor UX issues I have seen as an ignorant first time user. But love it so far!
❤️ 1
Avatar
I am just happily watching how my files upload - one feature idea which came to my mind is: multi threaded file uploading
Avatar
The announcement callout on the help page has very low contrast
Avatar
Currently it's OOMing a lot - I'll try to restart the app:
Avatar
Avatar
yz
I am just happily watching how my files upload - one feature idea which came to my mind is: multi threaded file uploading
We've had to explicitly switch to single-threaded mode to avoid/reduce freeze issues. Eventually we will improve in this area.
Avatar
Avatar
yz
The announcement callout on the help page has very low contrast
Thanks, I need to say we were using some defaults and balance between showing announcement and not making it too invasive. Personally looks balanced on my screen.
Avatar
Avatar
yz
Currently it's OOMing a lot - I'll try to restart the app:
That's interesting, out of curiosity, do you have E2E enabled?
Avatar
Avatar
Tom
We've had to explicitly switch to single-threaded mode to avoid/reduce freeze issues. Eventually we will improve in this area.
Fair! Totally understood
Avatar
Avatar
yz
Currently it's OOMing a lot - I'll try to restart the app:
... and if I can ask what's your phone model and OS version?
Avatar
Avatar
Tom
Thanks, I need to say we were using some defaults and balance between showing announcement and not making it too invasive. Personally looks balanced on my screen.
I find the announcement hard to read. Maybe I have set my phone screen to be too dark 🤷‍♂️
Avatar
Avatar
Tom
That's interesting, out of curiosity, do you have E2E enabled?
No, as far as I can tell I run a very thin sync here
Avatar
Avatar
Tom
... and if I can ask what's your phone model and OS version?
Pixel 7, Android 14, AP1A.240305.019.A1 (I just installed the March security update a few days ago) (edited)
Avatar
Fair enough, so specifications shouldn't be an issue at all. We need to investigate that. Sorry for this issue. If you feel you're not convinced whether photos are uploaded, you can use Reset and Match feature. In other words, you can use "Reset" to remove local cache of uploaded media files and then use: "Match" to fetch from remote whatever is uploaded and match by name with local media file. This would then update counters and reassure if anything that was supposed to be uploaded was uploaded. (edited)
Avatar
No worries, it's not my main backup method (yet). But I can run a sense check after the upload is complete
Avatar
Quick question did you start it via: "Start backup" button, or was it started automatically when app was started (or resumed via app switcher) or perhaps it was initiated by you taking a new photo?
Avatar
Avatar
Tom
Quick question did you start it via: "Start backup" button, or was it started automatically when app was started (or resumed via app switcher) or perhaps it was initiated by you taking a new photo?
I forced it via start backup. Tbh I haven't seen it automatically resuming the backup just yet.
FroodlieDoo joined the server. 3/17/2024 11:02 PM
Alves joined the server. 3/18/2024 9:45 AM
Andrei Filimonov joined the server. 3/19/2024 4:29 AM
Avatar
Avatar
FroodlieDoo
Click to see original message
Andrei Filimonov 3/19/2024 4:29 AM
Sticker
4:32 AM
Hi. I have a problem with sharing. When I share one file everything works OK. But if I try to share more then one link gives error. I use digital ocean object space. Has somebody met this problem? One plus 9rt. Android 13 (edited)
Avatar
Avatar
Andrei Filimonov
Hi. I have a problem with sharing. When I share one file everything works OK. But if I try to share more then one link gives error. I use digital ocean object space. Has somebody met this problem? One plus 9rt. Android 13 (edited)
Hi, Your bucket is likely missing CORS setup required for web browser. Please try setting CORS from the Settings, similar question: https://discord.com/channels/1069654792902815845/1217522466981675119/1217537237596766248
Avatar
Avatar
Tom
Hi, Your bucket is likely missing CORS setup required for web browser. Please try setting CORS from the Settings, similar question: https://discord.com/channels/1069654792902815845/1217522466981675119/1217537237596766248
Andrei Filimonov 3/19/2024 11:17 AM
Thanks for reply. What domain do I need to put there?
Avatar
Avatar
Tom
Hi, Your bucket is likely missing CORS setup required for web browser. Please try setting CORS from the Settings, similar question: https://discord.com/channels/1069654792902815845/1217522466981675119/1217537237596766248
Andrei Filimonov 3/19/2024 11:26 AM
It works. Thanks
Avatar
Andrei Filimonov 3/19/2024 11:39 AM
Is it possible to show thumbnails for shared files?
Avatar
Avatar
Andrei Filimonov
Is it possible to show thumbnails for shared files?
We will add thumbnails eventually. Just because there are some performance issues with rendering thumbnails on Web (especially when encryption is enabled), we've disabled them by default. There is an item: https://s3drive.canny.io/feature-requests/p/generate-thumbnails which we're working on, once it's finished we will enable thumbnails for shared files. (edited)
Once generated and stored, this would speed up thumbnail loading times on different devices, reduce stutter and reduce bandwidth usage dramatically.
👍 1
Avatar
Has anyone successfully set up the desktop version on Ubuntu 22.04? I’ve tried now three times with no success. I’m sure I’m missing something… feel like I’m following guides fairly well.
11:08 PM
My end goal is to connect IMMICH to file share if possible
Avatar
Avatar
t_rott
Has anyone successfully set up the desktop version on Ubuntu 22.04? I’ve tried now three times with no success. I’m sure I’m missing something… feel like I’m following guides fairly well.
Have you tried our Flathub release?
5:56 AM
Is it possible to install libmpv2 via alternative packages on your OS?
Avatar
i will try this and get back
Avatar
Avatar
Alves
Click to see original message
Sticker
Avatar
Avatar
Tom
We will add thumbnails eventually. Just because there are some performance issues with rendering thumbnails on Web (especially when encryption is enabled), we've disabled them by default. There is an item: https://s3drive.canny.io/feature-requests/p/generate-thumbnails which we're working on, once it's finished we will enable thumbnails for shared files. (edited)
great news
Avatar
Hey! I tried setting up rclone of a directory previously used with s3drive (based on a guide here https://docs.s3drive.app/advanced/?h=rclone) but I can't see decrypted folder content.. I can see encrypted contents in s3drive_remote, but s3drive_crypt listing shows no content at all. Using Backblaze backend btw, setup it with type = s3, any hints how to get this working? (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Avatar
Tom
Have you tried our Flathub release?
Ok I got it installed with flatpak. The files show up in the s3drive software but, when I mount it, it shows the files but I can not view the file or even look at properties. If I click on view image in preview image app, I get error: Error reading from file: input/output error
Avatar
Avatar
slano
Hey! I tried setting up rclone of a directory previously used with s3drive (based on a guide here https://docs.s3drive.app/advanced/?h=rclone) but I can't see decrypted folder content.. I can see encrypted contents in s3drive_remote, but s3drive_crypt listing shows no content at all. Using Backblaze backend btw, setup it with type = s3, any hints how to get this working? (edited)
Rclone is picky when it comes to displaying mixed encrypted and unencrypted files, so when you enable E2E encryption on your bucket, all your existing files (non-encrypted) won't appear on mount, but all new ones (encrypted) shall appear correctly. We have couple ideas how to overcome this, but we haven't exactly decided just yet. Please let me know if this addresses your issue.
Avatar
Avatar
t_rott
Ok I got it installed with flatpak. The files show up in the s3drive software but, when I mount it, it shows the files but I can not view the file or even look at properties. If I click on view image in preview image app, I get error: Error reading from file: input/output error
What's your provider? Do you have E2E encryption enabled? I assume that you can open files from S3Drive just fine - your user/IAM has the read access to files? (edited)
Avatar
Avatar
Tom
Rclone is picky when it comes to displaying mixed encrypted and unencrypted files, so when you enable E2E encryption on your bucket, all your existing files (non-encrypted) won't appear on mount, but all new ones (encrypted) shall appear correctly. We have couple ideas how to overcome this, but we haven't exactly decided just yet. Please let me know if this addresses your issue.
Thanks for the info, but I don't think that's the case since all my files have been encrypted using e2e from the moment I started uploading using s3drive. I tried one more test and it behaves like this: uploading a file using s3drive makes it inivisble in rclone [s3drive_crypt], uploading the file via rclone makes it available in rclone [s3drive_crypt], but file appears as encrypted once opened in s3drive. Maybe something to do with salt? I used "rclone obscure -" to obscure the password I used in e2e s3drive.
Avatar
Avatar
slano
Thanks for the info, but I don't think that's the case since all my files have been encrypted using e2e from the moment I started uploading using s3drive. I tried one more test and it behaves like this: uploading a file using s3drive makes it inivisble in rclone [s3drive_crypt], uploading the file via rclone makes it available in rclone [s3drive_crypt], but file appears as encrypted once opened in s3drive. Maybe something to do with salt? I used "rclone obscure -" to obscure the password I used in e2e s3drive.
In S3Drive you'll need to provide your plaintext password (not obscured). Password obscuration happens internally within S3Drive and creates mount config which is then fed to Rclone. If you use custom salt or 2nd password, this is not supported by S3Drive natively just yet: https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password you would need to configure your back-end using Rclone config screen, instead of standard S3 screen: https://docs.s3drive.app/setup/providers/#manual-setup (edited)
Avatar
Avatar
Tom
In S3Drive you'll need to provide your plaintext password (not obscured). Password obscuration happens internally within S3Drive and creates mount config which is then fed to Rclone. If you use custom salt or 2nd password, this is not supported by S3Drive natively just yet: https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password you would need to configure your back-end using Rclone config screen, instead of standard S3 screen: https://docs.s3drive.app/setup/providers/#manual-setup (edited)
Hmm.. I have a plaintext password in s3drive, obscured password is only used in rclone config. Salt and 2nd password is not used as well, I created rclone config based on the data on following page: https://docs.s3drive.app/advanced/?h=rclone
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Avatar
slano
Hmm.. I have a plaintext password in s3drive, obscured password is only used in rclone config. Salt and 2nd password is not used as well, I created rclone config based on the data on following page: https://docs.s3drive.app/advanced/?h=rclone
I assume you've used similar command to obscure password? echo "secretpassword" | rclone obscure - Can you provide your full Rclone config for your remote / back-end and crypt (remove your password sensitive credentials / access key etc.)
Avatar
Avatar
Tom
I assume you've used similar command to obscure password? echo "secretpassword" | rclone obscure - Can you provide your full Rclone config for your remote / back-end and crypt (remove your password sensitive credentials / access key etc.)
[s3drive_remote] type = s3 provider = Other access_key_id = <redacted> secret_access_key = <redatced> endpoint = s3.eu-central-003.backblazeb2.com [s3drive_crypt] type = crypt filename_encoding = base64 remote = s3drive_remote:bucket_name password = <password generated with echo "password-from-e2e-in-s3drive" | rclone obscure -> filename_encryption = standard directory_name_encryption = true suffix = none
Avatar
Avatar
slano
[s3drive_remote] type = s3 provider = Other access_key_id = <redacted> secret_access_key = <redatced> endpoint = s3.eu-central-003.backblazeb2.com [s3drive_crypt] type = crypt filename_encoding = base64 remote = s3drive_remote:bucket_name password = <password generated with echo "password-from-e2e-in-s3drive" | rclone obscure -> filename_encryption = standard directory_name_encryption = true suffix = none
That looks fine indeed. What's your Rclone version?
Avatar
Avatar
Tom
That looks fine indeed. What's your Rclone version?
v1.8.0
Avatar
Avatar
slano
v1.8.0
rclone version, I guess you've provided S3Drive version?
Avatar
Avatar
Tom
rclone version, I guess you've provided S3Drive version?
yes, that was s3drive version sorry, rclone: v1.53.3-DEV
  • os/arch: linux/amd64
  • go version: go1.18.1
Avatar
Avatar
slano
yes, that was s3drive version sorry, rclone: v1.53.3-DEV
  • os/arch: linux/amd64
  • go version: go1.18.1
We haven't tested that with anything below 1.6.5, I can't recall exactly, but there was some issue with S3Drive <> Rclone compatibility below that version. Would you be keen to upgrade your Rclone version and see if that config works for you?
Avatar
Avatar
Tom
We haven't tested that with anything below 1.6.5, I can't recall exactly, but there was some issue with S3Drive <> Rclone compatibility below that version. Would you be keen to upgrade your Rclone version and see if that config works for you?
sure thing, on it
Avatar
Avatar
slano
[s3drive_remote] type = s3 provider = Other access_key_id = <redacted> secret_access_key = <redatced> endpoint = s3.eu-central-003.backblazeb2.com [s3drive_crypt] type = crypt filename_encoding = base64 remote = s3drive_remote:bucket_name password = <password generated with echo "password-from-e2e-in-s3drive" | rclone obscure -> filename_encryption = standard directory_name_encryption = true suffix = none
directory_name_encryption = true - do you also have filename/filepath encryption enabled on the S3Drive side?
Avatar
Avatar
Tom
directory_name_encryption = true - do you also have filename/filepath encryption enabled on the S3Drive side?
yes I do
Avatar
Avatar
Tom
We haven't tested that with anything below 1.6.5, I can't recall exactly, but there was some issue with S3Drive <> Rclone compatibility below that version. Would you be keen to upgrade your Rclone version and see if that config works for you?
well, upgrading to 1.66.0 and regenerating obscured password did the trick, thanks! there probably is some breaking change in rclone, since I'm unable to decrypt the file uploaded via rclone version 1.53.3: 2024/03/21 14:49:41 NOTICE: q6iai7p6mlrj2joi3k4pvp6nio: Skipping undecryptable file name: not a multiple of blocksize (edited)
👍 1
Avatar
I’m using minio on another system on my lan. Yes everything works just fine in the S3Drive program. I’m going to assume yes on the Read question for I AM as I can use the S3Drive program to its full function? No I do not have EE encryption enabled. (edited)
Avatar
Ok, so with a little bit more sleauthing here is what i have been able to do: I can mount S3Drive in settings and all works fine I can see the "existing files" that were in the S3 bucket, in the mounted folder/drive but can not open them on the local machine that S3Drive is on I downloaded an image from google and saved it in the Mounted Folder and I am able to view the image on s3Drive and i can open the image in the mounted folder/drive and view it.
5:19 PM
So im going to isolate my question to specifically being able to view files that are existing in the s3 bucket, prior to installing s3drive. Thank you for your continued responses as im sure you are busy with current updates. This is a great program and solution. I look forward to continuing to utilize it. I can move this convo to support if you would like to not clutter up the gen-pop channel.
BabyPop joined the server. 3/21/2024 7:22 PM
CyberKiller joined the server. 3/22/2024 7:53 AM
Avatar
Avatar
CyberKiller
Click to see original message
9:37 AM
hi, I stumbled on this tool today, I'm looking on and off for something to be able to use a cheap pay as you go s3 storage, instead of shelling upfront for terabytes of google drive or dropbox, and this seems like it could be what I'm looking for
9:38 AM
that is if I manage to get it working, as I hit a problem on my OpenSUSE, posted a bug on the support chat
Avatar
Avatar
BabyPop
Click to see original message
Avatar
Avatar
CyberKiller
hi, I stumbled on this tool today, I'm looking on and off for something to be able to use a cheap pay as you go s3 storage, instead of shelling upfront for terabytes of google drive or dropbox, and this seems like it could be what I'm looking for
Indeed that was one of the initial idea when starting this project. Ability to use reasonably priced commodity storage as the file cloud with an option to self-host if needed (e.g. MinIO).
Avatar
Avatar
CyberKiller
that is if I manage to get it working, as I hit a problem on my OpenSUSE, posted a bug on the support chat
We'll try to address your issue as soon as possible. We use Linux based distro ourselves for app development and we love it, but believe me that it's somewhat tricky to get it all right across all Linux distributions (especially if combined with budget/resource planning and Linux tiny userbase vs Windows/Mac) (edited)
Avatar
Avatar
Tom
We'll try to address your issue as soon as possible. We use Linux based distro ourselves for app development and we love it, but believe me that it's somewhat tricky to get it all right across all Linux distributions (especially if combined with budget/resource planning and Linux tiny userbase vs Windows/Mac) (edited)
That's cool. I'm a senior engineer myself, so I should be able to provide you with all the debug info needed
sifayne joined the server. 3/24/2024 7:11 PM
Abubakr joined the server. 3/25/2024 6:44 AM
1azytrip joined the server. 3/26/2024 3:39 PM
Avatar
Avatar
sifayne
Click to see original message
raas joined the server. 3/26/2024 8:00 PM
Deleted User joined the server. 3/28/2024 4:40 PM
Avatar
Deleted User 3/28/2024 4:42 PM
Hi I just found s3drive today. I’ve been trying to upload a video file but each time I try it just fails half way through. I’ve tried via the app on iOS and the web browser. Any solution ?
Avatar
Avatar
Deleted User
Hi I just found s3drive today. I’ve been trying to upload a video file but each time I try it just fails half way through. I’ve tried via the app on iOS and the web browser. Any solution ?
Can you please create a support item? #support Please specify the error (you will probably find one in the Transfers tab), S3 provider, whether encryption is enabled and the approximate file size. Thanks.
👍 1
Riccardo Bellanova joined the server. 3/29/2024 9:13 PM
Avatar
Avatar
Riccardo Bellanova
Click to see original message
Riccardo Bellanova 3/29/2024 9:19 PM
9:21 PM
Hello 👋🏻, I'm looking for a long time something works as a drive with Cubbit S3 storage... Does it the right place? It's a dream?
Avatar
Avatar
Riccardo Bellanova
Hello 👋🏻, I'm looking for a long time something works as a drive with Cubbit S3 storage... Does it the right place? It's a dream?
Hi Riccardo, we've got quite a few users using S3Drive with Cubbit S3.
Avatar
Avatar
Tom
Hi Riccardo, we've got quite a few users using S3Drive with Cubbit S3.
Riccardo Bellanova 3/29/2024 9:53 PM
Top! I will try it in these days.. Thank you
Biel joined the server. 3/30/2024 3:47 AM
Avatar
Avatar
t_rott
So im going to isolate my question to specifically being able to view files that are existing in the s3 bucket, prior to installing s3drive. Thank you for your continued responses as im sure you are busy with current updates. This is a great program and solution. I look forward to continuing to utilize it. I can move this convo to support if you would like to not clutter up the gen-pop channel.
Sorry, I've missed this. Please go ahead, create a support item from after which we can hopefully find out where the problem lies.
Avatar
InfiniteAds559 3/30/2024 1:48 PM
Hi Tom, I remember I was able to download (not to my phone) individual media for offline use, and now the offline option is only available for folders.
Avatar
Deleted User 3/30/2024 4:57 PM
Does anyone know any zero knowledge clouds with encryption/vault that can be used via s3drive ?
kefir joined the server. 3/30/2024 9:49 PM
Avatar
Hi, I'm busy backing up my files to a remote s3 storage, in essence migrating away from Google photos. But I'm curious about the roadmap and the "Photo management tools" on the roadmap for 2024. I often search my media files by face recognition, by geographic location, and by date/time. How will that work with the planned s3drive features? Will a shared database/index be stored on s3, or will an index be local to a device? Will I have to re-index/process all files before they can be searched?
Aru99 joined the server. 3/31/2024 6:18 AM
Avatar
Avatar
Tom
Hi Riccardo, we've got quite a few users using S3Drive with Cubbit S3.
Hii I just installed this app nd it's saying this can u pls help me out?
ZenGnostic joined the server. 3/31/2024 7:56 AM
Riccardo Bellanova started a thread. 3/31/2024 9:51 AM
Avatar
Deleted User 3/31/2024 7:52 PM
Has anyone used koofr or koofr vault with the s3drive app ? if so can anyone help me please
Avatar
How much does cubbit cost?
5:17 AM
Their pricing page says nothing
Ronco joined the server. 4/1/2024 10:15 AM
beli3ver joined the server. 4/2/2024 9:43 AM
Avatar
Thank you. That's all I want to say. Just thanks to you. All other providers don't really allow me to preview video and images when I encrypt them. Or no mounting on Linux as a drive. Thank you. Really, thank you.
Avatar
Avatar
beli3ver
Thank you. That's all I want to say. Just thanks to you. All other providers don't really allow me to preview video and images when I encrypt them. Or no mounting on Linux as a drive. Thank you. Really, thank you.
Thanks for the good words. We're doing our best to make the encrypted experience as seamless as possible and constantly working on improving cipher in terms of security and performance. I hope that in the near future we will be able to provide even more encrypted features, as we're actively working on cipher improvements: https://github.com/rclone/rclone/issues/7192
We're running S3Drive (GUI for S3 on desktop, mobile, web) and recently aligned with Rclone's encryption scheme for better interoperability and features like drive mount and Webdav that we ...
d@rshan joined the server. 4/2/2024 1:26 PM
Avatar
@Tom Can you support an encrypted export of the config ?
Avatar
@Tom how can I sync a folder from the system without copy it to the storage? I use B2 and want to sync my /home/user/.ssh folder. Thanks.
Avatar
Avatar
beli3ver
@Tom Can you support an encrypted export of the config ?
I've just added this as a feature request: https://s3drive.canny.io/feature-requests/p/encrypted-export-of-the-config We will have it added likely in a couple months or sooner if we have some spare time.
Avatar
Avatar
beli3ver
@Tom how can I sync a folder from the system without copy it to the storage? I use B2 and want to sync my /home/user/.ssh folder. Thanks.
Sorry, I didn't get that. You can select local path, like on the attached screenshot and then select remote. Wouldn't that work?
Avatar
Found it, but when I click on the clock next to the time, I just see this:
4:08 PM
Just a black overlay but no window to set the sync time
4:08 PM
@Tom
Avatar
Avatar
beli3ver
Just a black overlay but no window to set the sync time
Oh dear, it seems there is a regression after we've updated our dependencies and our tests haven't captured that. I've passed that for fixing, in the meantime you can use the default "sync every" setting. Thanks for spotting that.
Avatar
Android the same 😄
4:13 PM
no problem just reporting it 🙂
4:14 PM
Should I test it with iOS too 😄
Avatar
Avatar
beli3ver
no problem just reporting it 🙂
Apparently the "quick" workaround would be to set the theme to Light (instead of Dark - this can be done in the Settings after opening a drawer menu), setting your preferred time and then reverting Theme settings back to your preferred. (edited)
Avatar
Avatar
beli3ver
Should I test it with iOS too 😄
Nope, it's broken on all platorms.
Avatar
Thanks, the workaround works
Darktoxicola joined the server. 4/3/2024 10:29 AM
Jo Colina joined the server. 4/3/2024 7:25 PM
Alberto joined the server. 4/4/2024 6:44 PM
Avatar
Avatar
Alberto
Click to see original message
EmporioBreak joined the server. 4/5/2024 5:27 AM
energetic joined the server. 4/5/2024 6:59 PM
ahtE joined the server. 4/6/2024 8:26 PM
VATER joined the server. 4/6/2024 8:52 PM
Avatar
InfiniteAds559 4/8/2024 1:00 AM
Hi Tom, what's your 3-2-1 back up implementation? I'm looking for a way to automate my local backup. Keeping tabs of which ones I haven't backed up yet on a local drive is tedious. What I'm thinking since I'm already using S3Drive-BackBlaze, is to back up BackBlaze to a local drive via spare mac mini I have laying around that does auto-back up when it detects new files. Kind of like Syncthing (Not sure if you're familiar with it). Thoughts?
Avatar
Avatar
InfiniteAds559
Hi Tom, what's your 3-2-1 back up implementation? I'm looking for a way to automate my local backup. Keeping tabs of which ones I haven't backed up yet on a local drive is tedious. What I'm thinking since I'm already using S3Drive-BackBlaze, is to back up BackBlaze to a local drive via spare mac mini I have laying around that does auto-back up when it detects new files. Kind of like Syncthing (Not sure if you're familiar with it). Thoughts?
I wouldn't say my setup is perfect or automated. I usually use old fashioned: rsync -av --exclude='cache' --exclude='build' source dest to sync data to other local machine and then archive things and send it compressed and password protected to Backblaze: 7z -mhc=on -mhe=on -pVeryHardPasswordHere a $folder.7z /home/tom/$folder/* AWS_ACCESS_KEY_ID=<key> AWS_SECRET_ACCESS_KEY=<access> aws --endpoint https://s3.eu-central-001.backblazeb2.com s3 cp $folder.7z s3://my-backup-bucket I use S3Drive to backup media from my phone to cloud and for online access to other media files (mostly older photos). I am yet to find perfect backup strategy for photos, but I would say at this stage bigger problem is to keep things tidy, organized and deduplicated. Eventually I will get to that. (edited)
Avatar
CyberKiller 4/8/2024 7:33 AM
if I may cut in... tools like this here, or other synced storage apps aren't really a good backup solution. It's only a backup in case of hardware failure, but not in other data loss scenarios. E.g. you delete a file by accident and that deletion get immidiately propagated to the remote storage, you lose both copies. A good backup tool takes snapshots periodicaly, and keeps a number of changed versions, so in case you delete a local copy, there is an earlier one that you can get back to. For cloud object storage I know of 2 pretty good backup tools. One is Restic, which can cooperate with Rclone to provide support to a huge number of providers, and compresses and encrypts the backups. Another is closed source CloudBerry Backup, though to get reasonable features you have to get a paid version and still it's mostly limited to S3 and Swift types. Restic requires to script around it, setup cron jobs or timers, drop old snapshots, prune storage etc (prunning takes a lot of bandwidth so it's a seldom operation), CloudBerry has a built-in scheduler. In any case, both are nice and most of all, you setup once and don't have to maintain this much later. (edited)
Avatar
Avatar
CyberKiller
if I may cut in... tools like this here, or other synced storage apps aren't really a good backup solution. It's only a backup in case of hardware failure, but not in other data loss scenarios. E.g. you delete a file by accident and that deletion get immidiately propagated to the remote storage, you lose both copies. A good backup tool takes snapshots periodicaly, and keeps a number of changed versions, so in case you delete a local copy, there is an earlier one that you can get back to. For cloud object storage I know of 2 pretty good backup tools. One is Restic, which can cooperate with Rclone to provide support to a huge number of providers, and compresses and encrypts the backups. Another is closed source CloudBerry Backup, though to get reasonable features you have to get a paid version and still it's mostly limited to S3 and Swift types. Restic requires to script around it, setup cron jobs or timers, drop old snapshots, prune storage etc (prunning takes a lot of bandwidth so it's a seldom operation), CloudBerry has a built-in scheduler. In any case, both are nice and most of all, you setup once and don't have to maintain this much later. (edited)
I've also heard positive comments about https://github.com/kopia/kopia tool, though I haven't used it personally.
A good backup tool takes snapshots periodicaly, and keeps a number of changed versions, so in case you delete a local copy, there is an earlier one that you can get back to.
I am not saying that I would recommend it (given that plenty other tools suited for backup purposes exist), but this could be achieved with Rclone and even S3Drive (if someone is afraid of Rclone + Cron CLI). There are 3 ingredients:
  • S3 bucket with enabled versioning,
  • Sync mode with periodic timer (e.g. every 24 hours),
  • Lifecycle policy to clean up older versions
(edited)
Avatar
CyberKiller 4/8/2024 7:45 AM
a versioned bucket is ok if you want to restore just single files, but if you'd want a directory tree from a particular date, then it's going to be a chore to select all those objects.
7:47 AM
I haven't heard of kopia before, but the features look nice
7:48 AM
though one thing that I feel missing from restic is support for cold storage like glacier or ovh archive; with e.g. using a separate hot bucket for metadata and the cold one just for data blobs
Avatar
Avatar
CyberKiller
a versioned bucket is ok if you want to restore just single files, but if you'd want a directory tree from a particular date, then it's going to be a chore to select all those objects.
You're right, but it's a matter of finding the right tooling to do the restore, because all of the data is materialized as versions with the proper timestamps in the S3 bucket. For instance you could tell... I want this directory with all of the files as of 3rd Jan 2022 2:00PM and it should retrieve the relevant data and restore the hierarchy. (edited)
Avatar
CyberKiller 4/8/2024 7:49 AM
in fact, I havent seen any modern tools which could do it, apart from Bareos (used with aws tape storage emulator), but I wouldn't call it modern 😉 (edited)
7:51 AM
in any case, it's always a matter of effort needed to use these kind of tools, having any backup is always good, even if it's just a copied floppy disk like we did in the 90s ;-D
Avatar
Avatar
CyberKiller
in any case, it's always a matter of effort needed to use these kind of tools, having any backup is always good, even if it's just a copied floppy disk like we did in the 90s ;-D
I am fine to spend little bit more effort on the restore side (as long as it works) and less on the backup side, since the frequency of these two is quite different. In other words I rely on backups more like disaster recovery, rather than some working copy to use.
Avatar
CyberKiller 4/8/2024 7:53 AM
oh yes, definitely
7:56 AM
my hobby server data survived the great OVH fire in 2021 (zero data lost!), so I take it my strategy is good enough (used restic daily snapshots, and pushed to swift in another datacenter location) (edited)
👍 1
Neoth joined the server. 4/8/2024 9:54 AM
Avatar
greetings gents
🫡 2
Yusarina joined the server. 4/8/2024 3:16 PM
sencha joined the server. 4/8/2024 5:06 PM
Avatar
Is it normal that you cannot upload files to the Bucket via the mount drive? If I upload a file via the S3Drive application, it can also be seen later in iDrivee2 and in the mounted drive of s3Drive. If a file is placed directly in the mounted drive, it is not loaded into the bucket of iDrivee2.
Avatar
Avatar
ReplaX
Is it normal that you cannot upload files to the Bucket via the mount drive? If I upload a file via the S3Drive application, it can also be seen later in iDrivee2 and in the mounted drive of s3Drive. If a file is placed directly in the mounted drive, it is not loaded into the bucket of iDrivee2.
Depending on the cache settings (available in the app) if file is copied to the mount drive, it shall either appear immediately in the bucket (cache: Off) or with with some small delay (depending on the connection speed, file size etc.). If file never appears, then there might be some issue involved in the upload process. What cache settings you use? Do you have E2E enabled? What region you use for iDrivee2? (edited)
Avatar
Avatar
Tom
Depending on the cache settings (available in the app) if file is copied to the mount drive, it shall either appear immediately in the bucket (cache: Off) or with with some small delay (depending on the connection speed, file size etc.). If file never appears, then there might be some issue involved in the upload process. What cache settings you use? Do you have E2E enabled? What region you use for iDrivee2? (edited)
Mount cache mode is "writes", e2ee enabled, reagion is frankfurt, germany
4:50 PM
4:50 PM
but im not in cached mode
Avatar
Avatar
ReplaX
Mount cache mode is "writes", e2ee enabled, reagion is frankfurt, germany
Thanks. Is name / filepath encryption also enabled? I will set up test environment on my end and will let you know if I've found anything later today.
👍🏻 1
Avatar
yes it is
Avatar
Avatar
ReplaX
yes it is
Hi, I've found the issue. If "Default encryption" setting is enabled on the iDrive side, then they return different object hashes which makes the integrity checks to fail for the mount. https://www.idrive.com/s3-storage-e2/rclone https://forum.rclone.org/t/issues-with-idrive-e2-corrupted-transfers/36085 We can fix that by setting the: server_side_encryption = aws:kms in the config, which we've checked solves the issue, the challenge is that we don't know if user actually enabled that setting on the iDrive side. The quick fix is to turn off the: "Default encryption" setting for the iDrive bucket, then the mount shall upload objects to iDrive without issues. We need to spend more time on this to research if we can detect this setting or whether we need to implement prompt/question for the user and provide configurable setting. (edited)
Avatar
Avatar
Tom
Hi, I've found the issue. If "Default encryption" setting is enabled on the iDrive side, then they return different object hashes which makes the integrity checks to fail for the mount. https://www.idrive.com/s3-storage-e2/rclone https://forum.rclone.org/t/issues-with-idrive-e2-corrupted-transfers/36085 We can fix that by setting the: server_side_encryption = aws:kms in the config, which we've checked solves the issue, the challenge is that we don't know if user actually enabled that setting on the iDrive side. The quick fix is to turn off the: "Default encryption" setting for the iDrive bucket, then the mount shall upload objects to iDrive without issues. We need to spend more time on this to research if we can detect this setting or whether we need to implement prompt/question for the user and provide configurable setting. (edited)
Tom you are the best! 😊 i have indeed Default encryption enabled at iDrive. I used your documentation for bucket setup https://docs.s3drive.app/setup/bucket/ and there is also default encryption enabled. But as you wrote there you used Backblaze. Maybe there its not a problem. You could add there the information that for idrive it should be disabled. I did the quick fix and now its working, Thank you very much!
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
👍 1
Avatar
Avatar
ReplaX
Tom you are the best! 😊 i have indeed Default encryption enabled at iDrive. I used your documentation for bucket setup https://docs.s3drive.app/setup/bucket/ and there is also default encryption enabled. But as you wrote there you used Backblaze. Maybe there its not a problem. You could add there the information that for idrive it should be disabled. I did the quick fix and now its working, Thank you very much!
Thanks for letting me know. I am glad it works now. In a next release once you try to setup iDrive or AWS mount you will get a prompt, which will allow you to keep Server Side encryption enabled.
👍🏻 1
Avatar
awesome 😊
Mazufa joined the server. 4/10/2024 11:04 PM
Avatar
Hello! 🙂
👋 1
Avatar
Avatar
Tom
Thanks for letting me know. I am glad it works now. In a next release once you try to setup iDrive or AWS mount you will get a prompt, which will allow you to keep Server Side encryption enabled.
just curious, does this work the same way for B2? They also have an encrypt at rest option.
Avatar
Avatar
povey
just curious, does this work the same way for B2? They also have an encrypt at rest option.
For B2 it has no effect on hashes, their encryption is transparent to the user.
👍 1
Avatar
Hi @Mazufa !
gregintheweb joined the server. 4/11/2024 1:53 PM
Avatar
a general question, the website mentions s3drive is capable of video playback... but can it play audio files too? and will it auto advance to the next file when playing? I mean, is it possible to use it like a music player with the files stored on a backend?
Avatar
Avatar
CyberKiller
a general question, the website mentions s3drive is capable of video playback... but can it play audio files too? and will it auto advance to the next file when playing? I mean, is it possible to use it like a music player with the files stored on a backend?
Yes, we can decrypt audio stream on the fly. These features are somewhat new, so if you find certain format that doesn't work well please let us know. Speaking of auto advance, it depends. On Android and iOS we've implemented audio player (with background playout) that has it's own playlist, which needs to be "configured" by selecting multiple files from the Files screen. In such case the auto-advance shall work. If you select a single file, then auto-advance won't work and you will have to navigate manually to next file. We are open for improvements, but we're facing couple challenges with our current audio player (for instance in 1.8.3 Windows release we've had to revert to use video player for audio) that we need to solve first, before we unify this environment. EDIT: On iOS/macOS there were couple other challenges related to strict format detection, we've released improvements in yesterday's 1.8.3 release. (edited)
Avatar
Ok good to know. As for improvements, the Mega sync app has a very good feature set for audio playback, you can look at that for ideas
9:57 AM
Nothing fancy, just treating all files in 1 directory as the playlist, repeat and shuffle, playback buttons, nothing else.
👍 1
Avatar
E2E encryption,will its Switches and Policies and Passwords be synced to another device which is same account same Configuration information in s3drive and not to easy on all my devices ?
Avatar
Avatar
mix9311
E2E encryption,will its Switches and Policies and Passwords be synced to another device which is same account same Configuration information in s3drive and not to easy on all my devices ?
Settings (especially related to security / E2E) are not synchronized between devices regardless if you're logged in to managed account or not.
789know joined the server. 4/13/2024 4:14 PM
Avatar
I know there is a description of the cache modes, but I'm not sure. if i am working with a program that needs to access the files from the mounted drive regularly (for reading and writing), which is the best cache mode?
Avatar
Avatar
ReplaX
I know there is a description of the cache modes, but I'm not sure. if i am working with a program that needs to access the files from the mounted drive regularly (for reading and writing), which is the best cache mode?
We still sort of haven't figured it out exactly the best setting. It really depends on the use case and required compatibility. If you're single user of a bucket and agree with eventual consistency behaviour (copied local file to the mount will be uploaded eventually, but it will take some time), then you can use Full. If multiple user use the bucket and you always want fresh copy when reading (avoiding stale cache issue if someone else modified then file in between), then you can use Writes. If you need strict behaviour that your copied file ends up in the remote destination once the copy/move operation finishes, then you could try using: Off and switch to: Minimal only if your app / process / file editor etc. doesn't cooperate well with the FS side effects like: "Files can't be opened for both read AND write". We will prepare a more detailed guide eventually, in the meantime if you have some feedback what works for you and what doesn't work that would be pretty useful feedback for us.
👍🏻 1
Avatar
hi, I got error when trying to setup sync from local to cloud
12:55 AM
file permission error, I have enabled access to local storage instead
Avatar
Avatar
rootdgc
hi, I got error when trying to setup sync from local to cloud
Hi, What's your Android version? (edited)
Avatar
hi, my android is android 10
Avatar
Avatar
Tom
We still sort of haven't figured it out exactly the best setting. It really depends on the use case and required compatibility. If you're single user of a bucket and agree with eventual consistency behaviour (copied local file to the mount will be uploaded eventually, but it will take some time), then you can use Full. If multiple user use the bucket and you always want fresh copy when reading (avoiding stale cache issue if someone else modified then file in between), then you can use Writes. If you need strict behaviour that your copied file ends up in the remote destination once the copy/move operation finishes, then you could try using: Off and switch to: Minimal only if your app / process / file editor etc. doesn't cooperate well with the FS side effects like: "Files can't be opened for both read AND write". We will prepare a more detailed guide eventually, in the meantime if you have some feedback what works for you and what doesn't work that would be pretty useful feedback for us.
I am the only user of the bucket. I work with music and video programs which are using wav, mp3, mp4 etc. I would also store the project files of the programs directly on the mounted drive. During the workflow, everything can be cached locally, but when the data is no longer actively used, it should be promptly moved to the bucket and should free the local storage again. Write sounds right to me, I'll give it a try.
Avatar
Avatar
ReplaX
I am the only user of the bucket. I work with music and video programs which are using wav, mp3, mp4 etc. I would also store the project files of the programs directly on the mounted drive. During the workflow, everything can be cached locally, but when the data is no longer actively used, it should be promptly moved to the bucket and should free the local storage again. Write sounds right to me, I'll give it a try.
Then you either can use modes: Writes or Full (combined with not yet configurable via S3Drive: vfs-cache-max-age setting, default 1h; In other words after 1h of not accessing files, they will be evicted from cache). If you switch to: "Old mount experience" in the Settings and have Rclone CLI installed, you can then lookup the exact command in the Logs and play with the settings yourself (based on this doc: https://rclone.org/commands/rclone_mount/#vfs-file-caching) We could then provide more configuration options in S3Drive ... or you are free to keep using Rclone outside of the S3Drive ecosystem. (edited)
👍🏻 1
9:44 AM
andentri joined the server. 4/14/2024 10:18 AM
Avatar
Avatar
andentri
Click to see original message
10:19 AM
Hi. I'm looking for the iOS app in iOS France App store and cannot find it. Is it planned to release it in France ?
❔ 1
Avatar
Avatar
andentri
Hi. I'm looking for the iOS app in iOS France App store and cannot find it. Is it planned to release it in France ?
There are some encryption laws in France which prevent us from releasing S3Drive without obtaining prior approval, please find more about that: https://github.com/s3drive/app/issues/48#issuecomment-1858809166
Hi! If I click on your web link to install the s3drive app on my device, the App Store says that it's not available in my country (France). BTW, discord links do not work also... (the ones in t...
Avatar
Avatar
Tom
Hi, What's your Android version? (edited)
android 10, color OS 7
Avatar
Avatar
rootdgc
android 10, color OS 7
We'll need to address it for Android older than 11.
Avatar
Hello, I try to set Sync on S3Drive appimage, but when I try to choose local folder, nothing happen. Seems like missed dependencies. What dependencies should I install?
Juergen_Bader joined the server. 4/14/2024 2:37 PM
Avatar
Avatar
Bryan
Hello, I try to set Sync on S3Drive appimage, but when I try to choose local folder, nothing happen. Seems like missed dependencies. What dependencies should I install?
Hi, If file / directory picker doesn't open that would usually be: zenity package missing on the host OS, alternatively kdialog can be installed. What's your OS? (edited)
Avatar
Avatar
Tom
Hi, If file / directory picker doesn't open that would usually be: zenity package missing on the host OS, alternatively kdialog can be installed. What's your OS? (edited)
Sorry for late replies, After install zenity, now file dialog can show. I'm using Void linux
Avatar
try to sync remote to local, but return error
1:38 PM
it's okay to share the error logs here? (edited)
Avatar
Avatar
Bryan
try to sync remote to local, but return error
Can you please create #support item? Does directory /home/jeannesbond/S3Drive exist on your machine? I would also recommend using external S3 account: https://docs.s3drive.app/setup/providers/ instead of testing account, as it's not always stable enough just yet. It's great you've included logs !
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
kinda random for S3Drive, but on Windows I use Bvckup 2 to sync an external drive shared from another Windows computer to a local drive. I see that S3 supports the SMB protocol, is it theoretically possible to use S3Drive as a backup client interface (similar to something like luckyBackup or Grsync) to sync a folder from one drive to another one? Seems like with RClone it should be possible: https://forum.rclone.org/t/how-to-access-smb-samba-with-rclone/42754
Kgolfer joined the server. 4/16/2024 2:19 PM
Avatar
Avatar
povey
kinda random for S3Drive, but on Windows I use Bvckup 2 to sync an external drive shared from another Windows computer to a local drive. I see that S3 supports the SMB protocol, is it theoretically possible to use S3Drive as a backup client interface (similar to something like luckyBackup or Grsync) to sync a folder from one drive to another one? Seems like with RClone it should be possible: https://forum.rclone.org/t/how-to-access-smb-samba-with-rclone/42754
Hi, You can configure SMB with S3Drive in a similar way as other protocols, https://docs.s3drive.app/setup/providers/#common-protocols-configuration e.g config: "smb": { "host": "smb.hostname.com", "pass": "<obscuredPass>", "type": "smb", "user": "usersomething" } Then you can set up Sync (from/to) or use the back-end in a same way as any other Rclone within S3Drive. (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
👍 1
Avatar
Avatar
Tom
Hi, You can configure SMB with S3Drive in a similar way as other protocols, https://docs.s3drive.app/setup/providers/#common-protocols-configuration e.g config: "smb": { "host": "smb.hostname.com", "pass": "<obscuredPass>", "type": "smb", "user": "usersomething" } Then you can set up Sync (from/to) or use the back-end in a same way as any other Rclone within S3Drive. (edited)
that's what I figured! Kinda unintuitive to use an app called "S3Drive" for a local folder sync solution, but I prefer a good UI over some batch scripts when possible 🙂
Avatar
Avatar
povey
that's what I figured! Kinda unintuitive to use an app called "S3Drive" for a local folder sync solution, but I prefer a good UI over some batch scripts when possible 🙂
Great, if you come across any issues or have any feedback then please us know ! Speaking of name, well, Rclone integration wasn't entirely planned from start. Idea to align ciphers with Rclone started around June 2023 where we were looking to provide our users with an open and standarized way to export their encypted data to avoid vendor lock-in. This idea evolved later in 2023 where we've realized how powerful would it be to integrate with Rclone lib to support other back-ends. It took us couple months to build and this is where we are, functionality geared up, yet name remain unchanged. Not that long ago, because in 2022 we were called: "Sync for Backblaze B2" and then later: "PhotoSync for S3". (https://s3drive.app/changelog). We've rewritten project completely and called it "S3Drive", as the idea was to expand it on all file types and all platforms (not just Android), but we never dreamed that eventually all these upgrades will be combined with most major back-ends and protocols. I need to say I am quite excited about all that. We've got couple other ideas how to expand this further with more integrations coming where eventually S3Drive will become part of bigger ecosystem / suite, not "just" app to manage files. (edited)
s3drive 1
👏 1
Avatar
Avatar
rootdgc
hi, I got error when trying to setup sync from local to cloud
Fix (support for Android 10 and older) will be included in a next release within couple days.
👍 1
🙏 1
ZNemesis joined the server. 4/17/2024 3:12 AM
Ángel joined the server. 4/17/2024 9:40 AM
Avatar
Avatar
Tom
Great, if you come across any issues or have any feedback then please us know ! Speaking of name, well, Rclone integration wasn't entirely planned from start. Idea to align ciphers with Rclone started around June 2023 where we were looking to provide our users with an open and standarized way to export their encypted data to avoid vendor lock-in. This idea evolved later in 2023 where we've realized how powerful would it be to integrate with Rclone lib to support other back-ends. It took us couple months to build and this is where we are, functionality geared up, yet name remain unchanged. Not that long ago, because in 2022 we were called: "Sync for Backblaze B2" and then later: "PhotoSync for S3". (https://s3drive.app/changelog). We've rewritten project completely and called it "S3Drive", as the idea was to expand it on all file types and all platforms (not just Android), but we never dreamed that eventually all these upgrades will be combined with most major back-ends and protocols. I need to say I am quite excited about all that. We've got couple other ideas how to expand this further with more integrations coming where eventually S3Drive will become part of bigger ecosystem / suite, not "just" app to manage files. (edited)
In addition to providing Rcloneaxcrypt E2E encryption, can other encryption algorithms be provided?
9:41 PM
When will release 1.8.5 app version ,upload to play store directly ?
Avatar
Avatar
mix9311
In addition to providing Rcloneaxcrypt E2E encryption, can other encryption algorithms be provided?
We have Cryptomator support on the radar: https://s3drive.canny.io/feature-requests/p/add-support-for-cryptomator-cipher What other algorithms do you have in mind? (edited)
Avatar
Avatar
mix9311
When will release 1.8.5 app version ,upload to play store directly ?
Please find the answer in the topic you've already asked about that: https://discord.com/channels/1069654792902815845/1230773952079597608/1231125140881018911
Avatar
@Tom can the upgraded app licence moved to another phone?
Avatar
Avatar
rootdgc
@Tom can the upgraded app licence moved to another phone?
If it's an in-app purchase, then you need to login to your Apple/Google account that made the purchase. If it's website purchase then you can simply login to S3Drive using your email/password credentials on your new phone. (edited)
Avatar
Avatar
Tom
There are some encryption laws in France which prevent us from releasing S3Drive without obtaining prior approval, please find more about that: https://github.com/s3drive/app/issues/48#issuecomment-1858809166
Thx for the head up
Avatar
what's a legal hold for backblaze B2 bucket single file encryption ,should it be opened , how to object lock and What does it do?
Avatar
Avatar
mix9311
what's a legal hold for backblaze B2 bucket single file encryption ,should it be opened , how to object lock and What does it do?
It protects your data from deletion for certain period. Imagine you have some important customer data that you must protect at all times and prevent from deletion... or perhaps you have some server backups that you would like to keep for e.g. 3 months.
Avatar
I understand Now I do.
Unlawful Cactus joined the server. 4/23/2024 2:41 PM
Avatar
Avatar
Unlawful Cactus
Click to see original message
Unlawful Cactus 4/23/2024 2:44 PM
Avatar
hi hi
Avatar
Unlawful Cactus 4/23/2024 2:58 PM
Hi, I'm new to Discord so excuse me if I do something weird. I was looking for a way to encrypt my files before syncing them to the cloud and came across rclone and S3Drive. I've been trying it out on Android 13 a bit and got the impression it's really early days but you guys are really motivated and working on it, which is great! I took some notes thinking user feedback is what will help you improve the app. Here they are, just some things I noticed, ran into or missed. O, I'm using an rclone config file with a WebDAV host and a crypt, and I'm syncing/copying (still on the free version) from internal storage to the crypt: 🔹 When activating cached mode the sort order changes (A-Z suddenly comes before a-z) and dot files are hidden 🔹 File timestamps only show date, not time, which for a syncing tool is not enough 🔹 Setting theme to System default sets it to Dark when you exit and re-enter the app 🔹 Light theme in new design has dark text and icons at the top of the screen instead of light (old design has light as it should be) 🔹 Dial to set sync interval is cumbersome; the dial in Google Clock and lots of other Android apps has a similar style but you can pick the hours separately, which is much faster when you want to set a long interval, e.g. once a day 🔹 Sync screen is sorted first to last added, no way to sort differently, e.g. alphabetically 🔹 In Settings, "Show image thumbnails" and "Show video thumbnails" are disabled and greyed out, but there's no mention why 🔹 The Trash screen says: Something went wrong Null check operator used on a null value 🔹 The logs don't mention what files were transferred or deleted
Avatar
Avatar
Unlawful Cactus
Hi, I'm new to Discord so excuse me if I do something weird. I was looking for a way to encrypt my files before syncing them to the cloud and came across rclone and S3Drive. I've been trying it out on Android 13 a bit and got the impression it's really early days but you guys are really motivated and working on it, which is great! I took some notes thinking user feedback is what will help you improve the app. Here they are, just some things I noticed, ran into or missed. O, I'm using an rclone config file with a WebDAV host and a crypt, and I'm syncing/copying (still on the free version) from internal storage to the crypt: 🔹 When activating cached mode the sort order changes (A-Z suddenly comes before a-z) and dot files are hidden 🔹 File timestamps only show date, not time, which for a syncing tool is not enough 🔹 Setting theme to System default sets it to Dark when you exit and re-enter the app 🔹 Light theme in new design has dark text and icons at the top of the screen instead of light (old design has light as it should be) 🔹 Dial to set sync interval is cumbersome; the dial in Google Clock and lots of other Android apps has a similar style but you can pick the hours separately, which is much faster when you want to set a long interval, e.g. once a day 🔹 Sync screen is sorted first to last added, no way to sort differently, e.g. alphabetically 🔹 In Settings, "Show image thumbnails" and "Show video thumbnails" are disabled and greyed out, but there's no mention why 🔹 The Trash screen says: Something went wrong Null check operator used on a null value 🔹 The logs don't mention what files were transferred or deleted
Such comments are extremely useful, so we can improve S3Drive, thank you ! Let me reply one by one.
When activating cached mode the sort order changes (A-Z suddenly comes before a-z) and dot files are hidden
This will be fixed in a next release in a few days. (See screenshot attached)
File timestamps only show date, not time, which for a syncing tool is not enough
We've added an option to display long date format. (See screenshot attached)
Setting theme to System default sets it to Dark when you exit and re-enter the app
This will be fixed in a next release in a few days.
Light theme in new design has dark text and icons at the top of the screen instead of light (old design has light as it should be)
That's default color scheme used by Google's Material 3 (you're right that previous one used white text color in the headings for the light theme instead), at this stage which we consider "best default". Eventually we will provide more flexibility in that area based on feedback that we get.
Dial to set sync interval is cumbersome; the dial in Google Clock and lots of other Android apps has a similar style but you can pick the hours separately, which is much faster when you want to set a long interval, e.g. once a day
We've used off-the-shelf library and will aim to replace it if we find a better candidate. Added feature request: https://s3drive.canny.io/feature-requests/p/improve-duration-picker-for-sync-interval
Sync screen is sorted first to last added, no way to sort differently, e.g. alphabetically
Added feature request: https://s3drive.canny.io/feature-requests/p/implement-sorting-options-for-sync-settings
In Settings, "Show image thumbnails" and "Show video thumbnails" are disabled and greyed out, but there's no mention why
It's not yet implemented. https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends https://s3drive.canny.io/feature-requests/p/implement-sorting-options-for-sync-settings
Avatar
Avatar
Unlawful Cactus
Hi, I'm new to Discord so excuse me if I do something weird. I was looking for a way to encrypt my files before syncing them to the cloud and came across rclone and S3Drive. I've been trying it out on Android 13 a bit and got the impression it's really early days but you guys are really motivated and working on it, which is great! I took some notes thinking user feedback is what will help you improve the app. Here they are, just some things I noticed, ran into or missed. O, I'm using an rclone config file with a WebDAV host and a crypt, and I'm syncing/copying (still on the free version) from internal storage to the crypt: 🔹 When activating cached mode the sort order changes (A-Z suddenly comes before a-z) and dot files are hidden 🔹 File timestamps only show date, not time, which for a syncing tool is not enough 🔹 Setting theme to System default sets it to Dark when you exit and re-enter the app 🔹 Light theme in new design has dark text and icons at the top of the screen instead of light (old design has light as it should be) 🔹 Dial to set sync interval is cumbersome; the dial in Google Clock and lots of other Android apps has a similar style but you can pick the hours separately, which is much faster when you want to set a long interval, e.g. once a day 🔹 Sync screen is sorted first to last added, no way to sort differently, e.g. alphabetically 🔹 In Settings, "Show image thumbnails" and "Show video thumbnails" are disabled and greyed out, but there's no mention why 🔹 The Trash screen says: Something went wrong Null check operator used on a null value 🔹 The logs don't mention what files were transferred or deleted
The Trash screen says: Something went wrong Null check operator used on a null value
How did you manage to enter Trash screen from the Rclone back-end? Currently it's implemented for S3 buckets that support versioning as it relies on the Versioning API
The logs don't mention what files were transferred or deleted
Current Logs are mostly to save some erroneous behavior or error, so user can then share it with us. We will aim to improve logging to provide better transparency. File logs/changes is a good idea, the challenge is that files are modified from a couple other places, either from our codebase itself or from the Rclone binary (mount, sync etc.), so it's not entirely straightforward for us to provide "merged" view of all operations. We need to think about that.
AtomicBaby joined the server. 4/23/2024 10:40 PM
1:16 AM
Sorry to hear about it, just because much failure of upload from s3drive
castlec joined the server. 4/24/2024 3:59 AM
Avatar
Avatar
mix9311
Click to see attachment 🖼️
If you're getting connection issues or timeouts when using Backblaze I can only suggest trying different provider (Cloudflare, Wasabi etc.). There isn't much we can do if your internet connection to Backblaze gets somehow limited or interfered by your ISP or VPN. You can also try using connecting to Backblaze using Rclone method (https://docs.s3drive.app/setup/providers/#s3) to rule out any issues that you might be having with our native S3 implementation... but we ourselves (and plenty of our users) use Backblaze on a daily basis without any problems. The fact that we're not listed on their integrations page doesn't make us less or more compatible, it's just an entry on their website. They are compatible with the S3 protocol, so is our software. Improvements in the areas of retry and timeout are coming: https://s3drive.canny.io/feature-requests/p/upload-retry-improvements You seem to comment on this issue multiple items in #support. Additional comments here on #general won't speed up our progress on that and clutter this chat for other users. Please stick to commenting under relevant #support item that you've opened and stay tuned for the updates. Thank you. (edited)
👍 1
alex joined the server. 4/24/2024 11:11 AM
Avatar
Avatar
alex
Click to see original message
Avatar
Avatar
alex
Click to see original message
Sticker
catreal joined the server. 4/24/2024 1:15 PM
Avatar
Avatar
Tom
Such comments are extremely useful, so we can improve S3Drive, thank you ! Let me reply one by one.
When activating cached mode the sort order changes (A-Z suddenly comes before a-z) and dot files are hidden
This will be fixed in a next release in a few days. (See screenshot attached)
File timestamps only show date, not time, which for a syncing tool is not enough
We've added an option to display long date format. (See screenshot attached)
Setting theme to System default sets it to Dark when you exit and re-enter the app
This will be fixed in a next release in a few days.
Light theme in new design has dark text and icons at the top of the screen instead of light (old design has light as it should be)
That's default color scheme used by Google's Material 3 (you're right that previous one used white text color in the headings for the light theme instead), at this stage which we consider "best default". Eventually we will provide more flexibility in that area based on feedback that we get.
Dial to set sync interval is cumbersome; the dial in Google Clock and lots of other Android apps has a similar style but you can pick the hours separately, which is much faster when you want to set a long interval, e.g. once a day
We've used off-the-shelf library and will aim to replace it if we find a better candidate. Added feature request: https://s3drive.canny.io/feature-requests/p/improve-duration-picker-for-sync-interval
Sync screen is sorted first to last added, no way to sort differently, e.g. alphabetically
Added feature request: https://s3drive.canny.io/feature-requests/p/implement-sorting-options-for-sync-settings
In Settings, "Show image thumbnails" and "Show video thumbnails" are disabled and greyed out, but there's no mention why
It's not yet implemented. https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends https://s3drive.canny.io/feature-requests/p/implement-sorting-options-for-sync-settings
Unlawful Cactus 4/24/2024 7:03 PM
Nice, you guys were already on it! Just installed the update. Ability to show modified time, sort order case insensitive in cached mode, theme stays on System default when selected... it's all there! 👍🏻 Cached mode still ignores the Hide dotfiles setting though. As for a better time picker, I think it's provided by Android: https://developer.android.com/develop/ui/views/components/pickers But I guess you want something cross-platform that looks exactly the same on both Android and iOS?
How did you manage to enter Trash screen from the Rclone back-end?
Simply from the drawer, see attached screenshot.
👍 1
Avatar
Avatar
Unlawful Cactus
Nice, you guys were already on it! Just installed the update. Ability to show modified time, sort order case insensitive in cached mode, theme stays on System default when selected... it's all there! 👍🏻 Cached mode still ignores the Hide dotfiles setting though. As for a better time picker, I think it's provided by Android: https://developer.android.com/develop/ui/views/components/pickers But I guess you want something cross-platform that looks exactly the same on both Android and iOS?
How did you manage to enter Trash screen from the Rclone back-end?
Simply from the drawer, see attached screenshot.
Cached mode still ignores the Hide dotfiles setting though.
We'll address that in a next release. Thanks
As for a better time picker, I think it's provided by Android: https://developer.android.com/develop/ui/views/components/pickers
The challenge (and the beauty at the same time) is that we use cross-platform technology (https://flutter.dev/), so whatever Android provides in terms of UI we can't really use it directly and must rely on Flutter packages (https://pub.dev/) or build one ourselves. The beauty is that once we get it working once, it works on all platforms.
Simply from the drawer, see attached screenshot.
I see, this option shall be removed to be honest, it's an UI mistake on our end. There isn't Trash concept / API with Rclone back-ends. (Exception, some back-ends support it e.g. Google Drive - https://forum.rclone.org/t/google-drive-trashed-only-in-config-file-not-showing-trash/37650 and setting: trashed_only = true) Stay tuned for the updates, in the meantime if you have any feedback don't hesitate to reach out. ... also I would like to thank you for your input. If you have registered an account I would happily assign you Ultimate license for one year - if that's something that would interest you.
(edited)
Avatar
what's a s3.kapsa.io , I don't know which object storage provider they're
Avatar
Avatar
Tom
Cached mode still ignores the Hide dotfiles setting though.
We'll address that in a next release. Thanks
As for a better time picker, I think it's provided by Android: https://developer.android.com/develop/ui/views/components/pickers
The challenge (and the beauty at the same time) is that we use cross-platform technology (https://flutter.dev/), so whatever Android provides in terms of UI we can't really use it directly and must rely on Flutter packages (https://pub.dev/) or build one ourselves. The beauty is that once we get it working once, it works on all platforms.
Simply from the drawer, see attached screenshot.
I see, this option shall be removed to be honest, it's an UI mistake on our end. There isn't Trash concept / API with Rclone back-ends. (Exception, some back-ends support it e.g. Google Drive - https://forum.rclone.org/t/google-drive-trashed-only-in-config-file-not-showing-trash/37650 and setting: trashed_only = true) Stay tuned for the updates, in the meantime if you have any feedback don't hesitate to reach out. ... also I would like to thank you for your input. If you have registered an account I would happily assign you Ultimate license for one year - if that's something that would interest you.
(edited)
Unlawful Cactus 4/25/2024 3:23 PM
Awesome, I won't say no to that! I'll DM you the e-mail address I used to sign up 📨
jgg joined the server. 4/25/2024 3:37 PM
Avatar
Avatar
mix9311
what's a s3.kapsa.io , I don't know which object storage provider they're
Unlawful Cactus 4/26/2024 2:13 PM
It seems to be S3Drive themselves, if you go to kapsa.io in a browser you end up on s3drive.app.
Avatar
Avatar
Unlawful Cactus
It seems to be S3Drive themselves, if you go to kapsa.io in a browser you end up on s3drive.app.
I kinda like the name kapsa more than s3drive tbh 🙂 the flatpak is also named kapsa, kinda interesting: https://github.com/flathub/io.kapsa.drive
Avatar
Thank u
Avatar
Wasabi said I must paid for it 6.99$ per month even if I use space less than 1TB storage,It didn't fit with my pay-as-you-go habit, so I gave up and deleted my account directly 😅
Avatar
Avatar
povey
I kinda like the name kapsa more than s3drive tbh 🙂 the flatpak is also named kapsa, kinda interesting: https://github.com/flathub/io.kapsa.drive
Unlawful Cactus 4/26/2024 4:18 PM
Agree! Don't know what it stands for, but it seems quite unique (maybe a made up word) and has more charm than the generic S3Drive.
Avatar
Avatar
mix9311
Wasabi said I must paid for it 6.99$ per month even if I use space less than 1TB storage,It didn't fit with my pay-as-you-go habit, so I gave up and deleted my account directly 😅
Avatar
I've closed s3drive during a sync. It's still syncing. The application exists in task manager but not in taskbar or system tray. Launching the application again has no effect. How can I stop the sync gracefully? (edited)
Avatar
Avatar
ZNemesis
I've closed s3drive during a sync. It's still syncing. The application exists in task manager but not in taskbar or system tray. Launching the application again has no effect. How can I stop the sync gracefully? (edited)
You might try clicking start and then stop again immediately, it will then cancel existing job(s) by its unique name based on the settings entry, which should also cancel the existing job. We will aim to add a kill switch in-app to kill sync jobs. In one of the future releases we will replace the standard app bar (the one with X close button) with custom one, so we can intercept "Quit" and then ask users if they want to e.g. stop mount, stop all transfers etc. (edited)
Avatar
The problem is I have no user interface in which to do this. s3drive appears in task manager but there is no window or system tray icon to interact with, and launching the app again does nothing
kp90 joined the server. 4/27/2024 7:19 AM
Avatar
Avatar
ZNemesis
The problem is I have no user interface in which to do this. s3drive appears in task manager but there is no window or system tray icon to interact with, and launching the app again does nothing
Is it one-way sync or bisync/two-way? If it's one-way you can certainly kill it without much consequences, it will start again next time (by fetching file metadata on both end and deciding about remaining uploads/downloads). We will investigate this "certainly not edge case" on our end, so we can improve how app behaves before sync has finished. (edited)
Avatar
Thankfully it's only one way copy, so I could kill the process, but I thought I'd ask about what's the intended graceful solution
7:56 AM
Maybe a popup on application exit confirming I do indeed want to exit while syncing is ongoing?
Avatar
Avatar
ZNemesis
Maybe a popup on application exit confirming I do indeed want to exit while syncing is ongoing?
Yep, it will come, but as mentioned in the post above, we need to replace system app bar, as current "quit" doesn't give us time before app gets closed by the OS. https://discord.com/channels/1069654792902815845/1069654792902815848/1233667288167616582 Thanks for mentioning about this, it clearly tells us we need to address this issue. (edited)
Avatar
Avatar
ZNemesis
Maybe a popup on application exit confirming I do indeed want to exit while syncing is ongoing?
What's your OS by the way? (edited)
Avatar
Win10
WingDemon joined the server. 4/27/2024 8:51 PM
Avatar
Avatar
WingDemon
Click to see original message
Sacha1083 joined the server. 4/28/2024 11:22 AM
gpkvt joined the server. 4/29/2024 5:35 AM
Streve joined the server. 4/29/2024 9:52 AM
Avatar
Unlawful Cactus 4/29/2024 9:06 PM
@Tom Here are some more things I ran into while working with S3Drive version 1.8.7 on Android 13 in the past few days. I've completed my setup now and everything is running smooth, so this will probably be my last report for now. Cheers! 🔹In the Sync screen, when you press play on a stopped item, you're asked "Would you like to start sync process now or wait until schedule is met?" and your options are Cancel or Start. When asked "now or wait?" I'd expect to be able to answer Now and Wait. As it is now, when you tap Cancel it interpretes that as wait, but I'd expect a Cancel button to cancel the action I just initiated, i.e. pressing the play button. But the item doesn't return to stopped/disactivated state when tapping Cancel. So it seems Cancel should actually be labeled Wait. 🔹Total storage space for one of my hosts is listed as 9 instead of 10 GB. It seems it's using GiB instead of GB and simply doing a math.floor() on that, hence misrepresenting the total by 10%. 🔹 When without internet connection, but with a VPN that reports "connected" (Proton VPN does this, no matter how long you've been offline; I can imagine local VPNs used for blocking certain types of traffic also do this), in most screens the loading spinner is permanently overlayed on the screen, which is also blurred when "Blur screen when loading" is enabled. The app is navigable but the back gesture doesn't work in the affected screens (using the UI to navigate back works fine). 🔹 The time picker for "Sync every x minutes" always opens at 30 minutes, regardless of the current setting (e.g. it's set to 1200 minutes, which is 20 hours, and you want to change it to 22 hours but you have to start from 30 minutes, which is especially cumbersome since the picker acts like a clock you have to forward manually) . (edited)
9:06 PM
🔹 My log is filled with tens or hundreds of entries like this one: #230 Rclone (1/3) initialization failed. Error: MissingPluginException(No implementation found for method RcloneRPCBackground on channel kapsa/librclonemobile) Is this to do with background syncing being a work in progress, or is it something else? 🔹 Last time when you reacted to my notes you said you added some feature requests to canny.io. Is it your intention that we create an account there and vote for the features we'd like to see? (edited)
Chaneira joined the server. 4/30/2024 6:02 AM
Avatar
Avatar
Unlawful Cactus
@Tom Here are some more things I ran into while working with S3Drive version 1.8.7 on Android 13 in the past few days. I've completed my setup now and everything is running smooth, so this will probably be my last report for now. Cheers! 🔹In the Sync screen, when you press play on a stopped item, you're asked "Would you like to start sync process now or wait until schedule is met?" and your options are Cancel or Start. When asked "now or wait?" I'd expect to be able to answer Now and Wait. As it is now, when you tap Cancel it interpretes that as wait, but I'd expect a Cancel button to cancel the action I just initiated, i.e. pressing the play button. But the item doesn't return to stopped/disactivated state when tapping Cancel. So it seems Cancel should actually be labeled Wait. 🔹Total storage space for one of my hosts is listed as 9 instead of 10 GB. It seems it's using GiB instead of GB and simply doing a math.floor() on that, hence misrepresenting the total by 10%. 🔹 When without internet connection, but with a VPN that reports "connected" (Proton VPN does this, no matter how long you've been offline; I can imagine local VPNs used for blocking certain types of traffic also do this), in most screens the loading spinner is permanently overlayed on the screen, which is also blurred when "Blur screen when loading" is enabled. The app is navigable but the back gesture doesn't work in the affected screens (using the UI to navigate back works fine). 🔹 The time picker for "Sync every x minutes" always opens at 30 minutes, regardless of the current setting (e.g. it's set to 1200 minutes, which is 20 hours, and you want to change it to 22 hours but you have to start from 30 minutes, which is especially cumbersome since the picker acts like a clock you have to forward manually) . (edited)
As always, thank you for such a great feedback. Please find reponses in line.
I'd expect to be able to answer Now and Wait.
In a next release we will tweak the wording. Behavior will remain unchaged, it's just the button labels will match the action.
Total storage space for one of my hosts is listed as 9 instead of 10 GB.
You were right, the base that our filesize library is using, is 1024 instead of 1000 and there was a rounding issue as well. Expect this to be fixed in a next release.
The time picker for "Sync every x minutes" always opens at 30 minutes, regardless of the current setting
This won't be an issue in a next release.
My log is filled with tens or hundreds of entries. #230 Rclone (1/3) initialization failed. Error: MissingPluginException [...]
We've been trying to narrow down the issue where Rclone methods were not always available to Android and implement some retry mechanism to check if "Rclone is ready" multiple times with certain back-off. It produces some noise, but ultimately this solution worked, so now we can probably disable this log. Unless you see: Rclone initialization failed. Please contact support[...] which indicates that after multiple tries the initialization failed, then nothing to worry about.
Is this to do with background syncing being a work in progress, or is it something else?
Some app functionality is dependent on great powers of Rclone library, however we need to call this library from the "background", so the app UI doesn't freeze. As such it doesn't have anything to do with the Android's background execution, but it's more of an internals about how we call Rclone library itself even when the app is in the foreground.
When without internet connection, but with a VPN that reports "connected" [...] The app is navigable but the back gesture doesn't work in the affected screens (using the UI to navigate back works fine).
We will investigate that, never tested app with a VPN honestly.
(edited)
Avatar
Avatar
Unlawful Cactus
🔹 My log is filled with tens or hundreds of entries like this one: #230 Rclone (1/3) initialization failed. Error: MissingPluginException(No implementation found for method RcloneRPCBackground on channel kapsa/librclonemobile) Is this to do with background syncing being a work in progress, or is it something else? 🔹 Last time when you reacted to my notes you said you added some feature requests to canny.io. Is it your intention that we create an account there and vote for the features we'd like to see? (edited)
Last time when you reacted to my notes you said you added some feature requests to canny.io. Is it your intention that we create an account there and vote for the features we'd like to see?
Canny is our current place where users can vote on the features (and technically even add them). I think our "best so far" workflow is to discuss features on Discord and then I add them to Canny myself. Unfortunately it's not linked with our auth, so if user wants to vote they need to create an account. I am sure that with some help of @Xenthys we may even integrate it with Discord, so there is a single platform and less barriers. Our intention is to integrate voting system with our auth and website (so no additional account is needed), but since we're awaiting changes to our auth system it's put on hold for a bit.
(edited)
Avatar
Unlawful Cactus 4/30/2024 9:47 AM
Alright, so no need for me to create a Canny account if I understand correctly.
Unless you see: Rclone initialization failed. Please contact support[...] which indicates that after multiple tries the initialization failed, then nothing to worry about.
This is exactly what I see, here's an example:
Avatar
Avatar
Unlawful Cactus
Alright, so no need for me to create a Canny account if I understand correctly.
Unless you see: Rclone initialization failed. Please contact support[...] which indicates that after multiple tries the initialization failed, then nothing to worry about.
This is exactly what I see, here's an example:
Crap, it's haunting us for quite a while. Do you happen to know if log entry was created after starting app fresh or perhaps when resuming an app (from the task bar, er I meant app switcher)... or perhaps it was created in the "background" (if you use media backup with background mode enabled) ? We can't reliably reproduce this and can see this being intermittent issue. Anyway, don't worry if you're not sure about that one. Any hints are welcomed, however it's on us to "play" with it and trace it down. (edited)
Avatar
Unlawful Cactus 4/30/2024 11:45 AM
No task bar on Android... ah, I'm using a phone, not a tablet or Chromebook. I get the idea it happens when I haven't been using the app. For example yesterday it was listed in the log around 21:45, whereas I hadn't opened the app all day, my sync jobs we're scheduled at 22:00 (but not expected to run as I'm given to understand background sync is not yet implemented). When I opened the app around 22:30 they ran just fine (per the Start sync after app starts setting). The Sync jobs are set to run every 20 hours, but had the app actually automatically done that in the background, that would've been around 21:05. Looking at the logs again, it did actually start all sync jobs around 21:40, listing Shall sync and Starting sync entries but never Finished sync. Which I can confirm, because before manually opening S3Drive at 22:30 I compared the contents of my local and remote backup in another app and changes had not been synced yet. However, the "Rclone initialization failed" entries that started at 00:40 and stopped at 00:50 (so lasted 10 minutes) were NOT preceded by any sync events. I don't have Media backup enabled at all, but I did try it out earlier, including Background backup. It's now disabled, but it still has a now non-existing album listed as selected, since the app complains when you remove the last album. I can't get a good understanding of when the app syncs and doesn't sync, but I haven't mentioned it before as I assume it's still a work in progress. For example, I have sync job A set with an interval of 20 hours and Start sync after app starts is enabled. In my testing, when still within 20 hours after the last sync, new files will not be synced when opening or even restarting the app. They will when opening the app after the 20 hours have expired. Then at other moments I tested, it actually synced upon starting the app, regardless of how long ago the last sync had taken place.
👍 1
11:45 AM
But if I disable the setting Start sync after app starts it stops doing that. Yet at other times, such as now, when I have recently opened the app, it will sync files in synced (watched?) folders immediately. Like, I create a new file locally, then immediately list my remote with another app and see it has been synced. All the while in all the unexpected sync situations described, the Sync jobs still say Last: x hours ago, even though files just got synced. Hope that helps. If taking a logcat would be helpful, just let me know. I have no job and no family to take care of so I've got plenty of time on my hands and am glad to help out 🙂 (edited)
Avatar
A lot of Android apps that need to run in the background use a permanent notification to stay active, otherwise even with battery optimizations disabled the system is still quite agressive when it comes to killing apps you haven't opened for a few hours or days. I use both FairMail and Gotify that implement this mechanism, I took the risk to disable the Gotify notification and I have to relaunch it from times to times.
Avatar
when you mount a drive, you show a popup asking the user if default encryption is used on the bucket, if they say yes, you write "kmsEncryption":true in the json config, but may I also suggest writing server_side_encryption = aws:kms in the rclone config
12:42 AM
I suggest this because I came across this issue in s3drive: https://github.com/rclone/rclone/issues/1824
Scripts to reproduce this bug can be found here: https://github.com/ccoakley/rclone-kms-s3-test We wanted to make sure it wasn't tied to our particular environment, so the above scripts can be ...
12:44 AM
(I was using s3drive to sync, and it was giving me md5 errors similar to the above)
Avatar
adding server_side_encryption = aws:kms in the rclone config manually will be overwritten by s3drive removing it
Avatar
Avatar
ZNemesis
when you mount a drive, you show a popup asking the user if default encryption is used on the bucket, if they say yes, you write "kmsEncryption":true in the json config, but may I also suggest writing server_side_encryption = aws:kms in the rclone config
Once: kmsEncryption is set to true in the config, then we should already be setting: server_side_encryption = aws:kms in the Rclone config. Does S3Drive behave differently? The issue that we're aware of is that we only display dialog which sets the: kmsEncryption value when you mount a drive (we ask that for AWS and iDrive only). We need to fix that, so dialog is displayed also for Sync and other functionalities which internally use Rclone. Even though I don't necessarily recommend modifying app's config, a temporary solution might be setting: kmsEncryption: true in the config (ideally when app is disabled) and then starting app. What's your S3 provider by the way? (edited)
Avatar
idrive
Avatar
Avatar
ZNemesis
idrive
Once I select "Yes" in the prompt when mounting iDrive, I can see: server_side_encryption being set in the Rclone config. Isn't what you finding? (edited)
Avatar
I deleted and set up my configuration again manually, including the sync, making sure to mount the drive before doing any syncs, and now the rclone config is keeping the server_side_encryption setting properly. I don't know what happened. I still have the json config timestamped Sunday, ‎21 ‎April ‎2024, ‏‎12:57:39 AM with "kmsEncryption":true, inside of it.
9:23 AM
I don't remember what sequence of steps I did 2 weeks ago to set it up to reproduce the issue, sorry.
Avatar
Just a quick thing, couldn't see it mentioned but it may have been! When using encryption within the app, thumbnails for images still seem to work fine, but for videos they're showing as black boxes. Is this just how it is at the moment? I'm using Backblaze for the storage provider.
Etaoin joined the server. 5/3/2024 5:40 AM
Kajo joined the server. 5/3/2024 10:17 AM
Avatar
Getting this trying to buy a plan?
🆗 1
Avatar
use another browser
Avatar
Thanks fair, gonna have to wait to get the card I don’t have passwords saved on Edge
Avatar
That's odd you got an alert, especially an empty one, I believe @Tom will want to know more or may already have a clue
Avatar
Avatar
Kajo
Getting this trying to buy a plan?
Hi there, sorry for this issue. Quick question was it one-time issue, did you try again? If problem persists can you please let me know what's your browser? Is it possible by any chance for you to open Console log and see if there is anything useful there? If you DM me your e-mail I can get you 3 months trial just to kick-start things ! (edited)
Fabio joined the server. 5/4/2024 8:43 PM
Ankan joined the server. 5/5/2024 3:31 PM
AnkanB joined the server. 5/5/2024 3:43 PM
Avatar
Hi All. I am new to this kind of set up. I wanted to ask you all how much charges do we incur for about 500GB of storage through S3 and then host it on S3Drive? I currently use about 125GB overall on OneDrive.
4:38 PM
@Tom Was that you I was talking to on reddit?
Avatar
Avatar
AnkanB
Hi All. I am new to this kind of set up. I wanted to ask you all how much charges do we incur for about 500GB of storage through S3 and then host it on S3Drive? I currently use about 125GB overall on OneDrive.
Hi @AnkanB and welcome to our channel. 👋 It was indeed myself. Each S3 provider has a slightly different billing model: https://docs.s3drive.app/setup/bucket/#s3 Just for start you can try free 10GB account at Backblaze, setup a bucket and connect from the app: https://docs.s3drive.app/setup/bucket/ If you were to store 125GB, you would pay approximately 0.125*$6 = 0.75 US$ per month based on current ($6 per TB/mo) https://www.backblaze.com/cloud-storage/pricing There are other things to watch out for, that is egress (if you were to download more than 3x125GB month = 375GB) or use a lot of API calls (e.g. run some backup syncing very frequently). You can use S3Drive entirely for free and if you need more advanced features or encryption feel free to check our paid offering: https://s3drive.app/pricing (edited)
👋 1
Avatar
Thank you so much. I will try to start doing this. Looks a tad complicated but certainly helps. Thank you again.
Avatar
Avatar
Unlawful Cactus
No task bar on Android... ah, I'm using a phone, not a tablet or Chromebook. I get the idea it happens when I haven't been using the app. For example yesterday it was listed in the log around 21:45, whereas I hadn't opened the app all day, my sync jobs we're scheduled at 22:00 (but not expected to run as I'm given to understand background sync is not yet implemented). When I opened the app around 22:30 they ran just fine (per the Start sync after app starts setting). The Sync jobs are set to run every 20 hours, but had the app actually automatically done that in the background, that would've been around 21:05. Looking at the logs again, it did actually start all sync jobs around 21:40, listing Shall sync and Starting sync entries but never Finished sync. Which I can confirm, because before manually opening S3Drive at 22:30 I compared the contents of my local and remote backup in another app and changes had not been synced yet. However, the "Rclone initialization failed" entries that started at 00:40 and stopped at 00:50 (so lasted 10 minutes) were NOT preceded by any sync events. I don't have Media backup enabled at all, but I did try it out earlier, including Background backup. It's now disabled, but it still has a now non-existing album listed as selected, since the app complains when you remove the last album. I can't get a good understanding of when the app syncs and doesn't sync, but I haven't mentioned it before as I assume it's still a work in progress. For example, I have sync job A set with an interval of 20 hours and Start sync after app starts is enabled. In my testing, when still within 20 hours after the last sync, new files will not be synced when opening or even restarting the app. They will when opening the app after the 20 hours have expired. Then at other moments I tested, it actually synced upon starting the app, regardless of how long ago the last sync had taken place.
I can't get a good understanding of when the app syncs and doesn't sync, but I haven't mentioned it before as I assume it's still a work in progress. For example, I have sync job A set with an interval of 20 hours and Start sync after app starts is enabled. In my testing, when still within 20 hours after the last sync, new files will not be synced when opening or even restarting the app. They will when opening the app after the 20 hours have expired.
In order for Sync to run app needs to run, if it's mobile it needs to run in the foreground. No background sync has been implemented just yet. In a next Android release there will be an improvement preventing app from going sleep when sync runs.
Avatar
Avatar
Unlawful Cactus
But if I disable the setting Start sync after app starts it stops doing that. Yet at other times, such as now, when I have recently opened the app, it will sync files in synced (watched?) folders immediately. Like, I create a new file locally, then immediately list my remote with another app and see it has been synced. All the while in all the unexpected sync situations described, the Sync jobs still say Last: x hours ago, even though files just got synced. Hope that helps. If taking a logcat would be helpful, just let me know. I have no job and no family to take care of so I've got plenty of time on my hands and am glad to help out 🙂 (edited)
In a next Android release there will be certain improvements around Sync (and other Rclone functionality) in general. Currently it was all slightly bottlenecked (if one operation was running it was blocking other operations). "Last" field indicates when last full sync was executed. When file sync is triggered from the watcher it doesn't update the "Last" field, since the sync was only partial and there is a risk that there are other changes awaiting sync (it technically shouldn't happen given the file watchers are there), but better to be safe than sorry. Initially we will add a tooltip improving clarity of this field. In the long-run once we're sure that watchers pick-up all the changes we can perhaps provide real-time info based on last full sync and subsequent diff sync. (edited)
👍 1
Avatar
Unlawful Cactus 5/5/2024 6:26 PM
What host or service (e.g. Google Analytics) does the Android app use for error reporting? I normally disable all telemetry on apps I use, but I'd like to help out here. However, I use AdGuard DNS and there's no way to make an exception for one app, so I wonder if keeping the setting enabled actually does anything useful on my device.
Avatar
Avatar
Unlawful Cactus
What host or service (e.g. Google Analytics) does the Android app use for error reporting? I normally disable all telemetry on apps I use, but I'd like to help out here. However, I use AdGuard DNS and there's no way to make an exception for one app, so I wonder if keeping the setting enabled actually does anything useful on my device.
If error reporting is enabled in the Settings as per our privacy policy, some errors (usually unhandled ones) go to our self-hosted Sentry instance: https://sentry.s3drive.app
Somenerd joined the server. 5/5/2024 8:14 PM
Avatar
Avatar
Tom
If error reporting is enabled in the Settings as per our privacy policy, some errors (usually unhandled ones) go to our self-hosted Sentry instance: https://sentry.s3drive.app
Unlawful Cactus 5/5/2024 8:23 PM
Alright, good to know. That won't be blocked by AdGuard DNS then 👍
E-Wind joined the server. 5/5/2024 9:40 PM
Avatar
Avatar
Unlawful Cactus
Alright, so no need for me to create a Canny account if I understand correctly.
Unless you see: Rclone initialization failed. Please contact support[...] which indicates that after multiple tries the initialization failed, then nothing to worry about.
This is exactly what I see, here's an example:
This issue should be gone in a current Android release or at least this log shouldn't appear as often.
Avatar
Avatar
Unlawful Cactus
@Tom Here are some more things I ran into while working with S3Drive version 1.8.7 on Android 13 in the past few days. I've completed my setup now and everything is running smooth, so this will probably be my last report for now. Cheers! 🔹In the Sync screen, when you press play on a stopped item, you're asked "Would you like to start sync process now or wait until schedule is met?" and your options are Cancel or Start. When asked "now or wait?" I'd expect to be able to answer Now and Wait. As it is now, when you tap Cancel it interpretes that as wait, but I'd expect a Cancel button to cancel the action I just initiated, i.e. pressing the play button. But the item doesn't return to stopped/disactivated state when tapping Cancel. So it seems Cancel should actually be labeled Wait. 🔹Total storage space for one of my hosts is listed as 9 instead of 10 GB. It seems it's using GiB instead of GB and simply doing a math.floor() on that, hence misrepresenting the total by 10%. 🔹 When without internet connection, but with a VPN that reports "connected" (Proton VPN does this, no matter how long you've been offline; I can imagine local VPNs used for blocking certain types of traffic also do this), in most screens the loading spinner is permanently overlayed on the screen, which is also blurred when "Blur screen when loading" is enabled. The app is navigable but the back gesture doesn't work in the affected screens (using the UI to navigate back works fine). 🔹 The time picker for "Sync every x minutes" always opens at 30 minutes, regardless of the current setting (e.g. it's set to 1200 minutes, which is 20 hours, and you want to change it to 22 hours but you have to start from 30 minutes, which is especially cumbersome since the picker acts like a clock you have to forward manually) . (edited)
These issues (Sync now/wait text tweaks, GiB / GB discrepancies and time picker persistence) shall be addressed in a most recent Android release.
val andreev joined the server. 5/7/2024 7:28 AM
Avatar
Riccardo Bellanova 5/7/2024 8:08 AM
Good morning, there's a way to contribute for Italian translation? Or it's too early?
Avatar
Avatar
Tom
Hi there, sorry for this issue. Quick question was it one-time issue, did you try again? If problem persists can you please let me know what's your browser? Is it possible by any chance for you to open Console log and see if there is anything useful there? If you DM me your e-mail I can get you 3 months trial just to kick-start things ! (edited)
Seems to have fixed itself now, it was only on chrome but chromes the only browser with a saved card on my pc so it was an issue. I’ve checked now and all works as it should
👍 1
8:22 AM
It was chrome 124
Avatar
Avatar
Kajo
Seems to have fixed itself now, it was only on chrome but chromes the only browser with a saved card on my pc so it was an issue. I’ve checked now and all works as it should
Thanks for letting me know. In the meantime we've added some more verbose error messaging, so at least the error isn't empty !
dq joined the server. 5/7/2024 7:24 PM
Avatar
Avatar
dq
Click to see original message
cjohlandt joined the server. 5/8/2024 1:20 AM
Avatar
Unlawful Cactus 5/8/2024 12:54 PM
Just noticed the improvements! 😃👍🏻
👍 1
Avatar
Avatar
Unlawful Cactus
Just noticed the improvements! 😃👍🏻
Great to hear that, you were driving these changes ! If you have any more ideas / feedback we would be glad to include them in our planning or next releases. Thank you. PS(A): Anyone can send us some improvement ideas / bug reports even as small ones as the ones above. (edited)
Avatar
Hi, can this feature not be used?
Avatar
Avatar
AnkanB
Hi, can this feature not be used?
On iOS we don't have access to local filesystem. In the future we plan to implement this using local folder tied to the S3Drive which then could be subseqently shared to other apps.
Avatar
I will wait for the update then. Thanks!
Avatar
Hey, is there an official support email or something? I still don't have any answers on my thread in the support forum.
Avatar
Avatar
Chaneira
Hey, is there an official support email or something? I still don't have any answers on my thread in the support forum.
Hi sorry, it seems we've missed your item here: https://discord.com/channels/1069654792902815845/1234871818221912104 which I've now replied to. If Discord doesn't work for you for any reason, you can reach us via standard support e-mail or: https://s3drive.app/feedback
Avatar
Thanks!
Parker joined the server. 5/9/2024 6:18 PM
CLP Reaper joined the server. 5/9/2024 7:42 PM
Avatar
@tom when I renamed a file , the old file still exist, is this expected behaviour or bug ?
2:32 AM
@Tom
Avatar
Avatar
rootdgc
@tom when I renamed a file , the old file still exist, is this expected behaviour or bug ?
It's certainly unexpected, might be a bug or bucket misconfiguration. What's your S3 provider? Does your bucket has versioning enabled or disabled? What's your Versioning setting in S3Drive?
Avatar
Avatar
Tom
It's certainly unexpected, might be a bug or bucket misconfiguration. What's your S3 provider? Does your bucket has versioning enabled or disabled? What's your Versioning setting in S3Drive?
I use idrive e2, will check again about versioning
11:52 AM
11:53 AM
I try to enable versioning but that warning came up
11:54 AM
is it need to be enabled to correct the bug ?
Avatar
Avatar
rootdgc
is it need to be enabled to correct the bug ?
This is relatively new check that actually prevents incorrect settings. Your versioning is disabled on the bucket level, therefore it should stay disabled on the S3Drive as well. (edited)
Avatar
Unlawful Cactus 5/11/2024 11:30 AM
It's just a minor thing but... will the Android app get an adaptive icon in the future?
Sean joined the server. 5/11/2024 1:17 PM
Avatar
Just disocvered S3Drive woohoo 😀 Couple questions: Does S3Drive support Filen and/or IceDrive?
Deleted User joined the server. 5/11/2024 4:36 PM
Avatar
Unlawful Cactus 5/11/2024 6:37 PM
@Sean Hey, I'm not affiliated with S3Drive, just an end user like you, but I had a look and as far as open protocols go Filen seems to have “WebDAV client and rclone integration” on their roadmap¹ for 2023/2024 and IceDrive supports WebDAV². So IceDrive can already be set up through S3Drive's Rclone support and Filen may in the future. Do note that using the WebDAV protocol has its limitations³. ¹https://filen.io/roadmap ²https://icedrive.net/help/account/does-icedrive-support-webdav ³https://rclone.org/webdav/#modification-times-and-hashes
Filen – Next Generation End-To-End Encrypted Cloud Storage. Get started with 10 GB of free space.
Rclone docs for WebDAV
😍 1
Jason Robinson joined the server. 5/12/2024 10:25 PM
Tenzin joined the server. 5/13/2024 9:34 PM
Avatar
Avatar
Tenzin
Click to see original message
Keith joined the server. 5/15/2024 2:59 AM
pce joined the server. 5/15/2024 1:22 PM
Avatar
Avatar
Unlawful Cactus
It's just a minor thing but... will the Android app get an adaptive icon in the future?
Certainly we'll have them implemented soon. Added to our feature requests, so we can track it. Thanks for reminding us about that ! https://s3drive.canny.io/feature-requests/p/implement-adaptive-icon (edited)
👍 1
pm joined the server. 5/17/2024 11:19 AM
Avatar
Avatar
Tom
Certainly we'll have them implemented soon. Added to our feature requests, so we can track it. Thanks for reminding us about that ! https://s3drive.canny.io/feature-requests/p/implement-adaptive-icon (edited)
InfiniteAds559 5/17/2024 7:50 PM
Will there be a different icon in the works as well?
7:57 PM
Does the mount function work similar to having a microSD? I'd like the ability to export daily backup function to automatically place the file in S3 rather than the stock files app
spaceb0t joined the server. 5/18/2024 8:31 AM
Evmosian joined the server. 5/18/2024 8:33 AM
Avatar
Avatar
Evmosian
Click to see original message
8:35 AM
Hello I'm newbie on S3Drive and docs has no sufficient info to use it with services. Why there is no tutorials with examples? BTW I cannot sign up even with dozen characters strong password.
Avatar
Appimage stucks when try to login.
8:48 AM
cant close etc. only via killing/terminate closes it
8:52 AM
flatpak version also stuck
Avatar
Avatar
Evmosian
Appimage stucks when try to login.
Hi @Evmosian Can you please create a support item and include information (OS system at least)? https://discord.com/channels/1069654792902815845/1102236355645419550 If you run Flatpak or AppImage from the command line do you get any output? It's possible there is an issue with libsecret. (edited)
Avatar
Avatar
Evmosian
Hello I'm newbie on S3Drive and docs has no sufficient info to use it with services. Why there is no tutorials with examples? BTW I cannot sign up even with dozen characters strong password.
Hi ! You can find S3 bucket setup (using Backblaze as an example) here: https://docs.s3drive.app/setup/bucket/ For any other provider, there is a list with some examples here: https://docs.s3drive.app/setup/providers/ Please let us know what are you trying to achieve, so we can help you set things up. Please use https://discord.com/channels/1069654792902815845/1102236355645419550 channel. Thank you.
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
pizzabed joined the server. 5/19/2024 4:41 AM
Avatar
Hello, I couldn't find this in the FAQ but is the S3Drive Windows application capable of displaying images and videos in an rclone crypt remote in a gallery view?
Avatar
Avatar
pizzabed
Hello, I couldn't find this in the FAQ but is the S3Drive Windows application capable of displaying images and videos in an rclone crypt remote in a gallery view?
Hi, it's not yet available, however it's something we will implement possibly later this year. Hard to give an exact ETA though, as it does require some changes to the rclone first (there is no streaming interface that we could use). (edited)
Avatar
Avatar
Tom
Hi, it's not yet available, however it's something we will implement possibly later this year. Hard to give an exact ETA though, as it does require some changes to the rclone first (there is no streaming interface that we could use). (edited)
If there's no streaming interface, how can S3Drive do on-the-flly video playback?
Avatar
Avatar
pizzabed
If there's no streaming interface, how can S3Drive do on-the-flly video playback?
That applies to S3 back-ends, Rclone support was added recently.
Avatar
Avatar
pizzabed
If there's no streaming interface, how can S3Drive do on-the-flly video playback?
We've implemented S3 natively, outside of Rclone and can do way more, due to custom nature of our implementation.
Avatar
Oh, I'm sorry, I was under the impression S3Drive was some kind of rclone frontend with optional hosting features
8:05 AM
For some reaso, I thought it was some kind of GUI that sits on top of rclone
Avatar
Avatar
pizzabed
Oh, I'm sorry, I was under the impression S3Drive was some kind of rclone frontend with optional hosting features
No worries, I think there are multiple use cases for S3Drive and the name that we've chosen back in 2022 probably doesn't help here. As such S3Drive is a simple back-end for Rclone, technically in some ways it is a GUI that sits on top of Rclone, but that's our additional feature, not the core one. The core one revolves around S3 support and storage plans will be available later this year. We still plan to expand support for Rclone back-ends, including preview, thumbnails etc.
Avatar
Avatar
pizzabed
For some reaso, I thought it was some kind of GUI that sits on top of rclone
One of the crucial features that we aim to implement is native support for back-ends configuration, so you wouldn't need to setup Rclone on your desktop first to setup OAuth2 back-ends: https://docs.s3drive.app/setup/providers/#oauth2 Instead one would simply give login/password to their, IDK, Google Drive and then we would be able to obtain all the required API tokens on behalf of the user. (edited)
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
Alright, gotcha, I guess I'll check it out from time to time to see how the rclone stuff comes along. I don't really use S3 which I guess I should've paid more attention to the name of the app itself lol It's just I saw a couple posts about this on rclone threads on Reddit and I saw rclone mentioned quite a bbit on the website so I guess my dumb monkey brain just automatically assumed it's a dedicated rclone client
Avatar
Avatar
pizzabed
Alright, gotcha, I guess I'll check it out from time to time to see how the rclone stuff comes along. I don't really use S3 which I guess I should've paid more attention to the name of the app itself lol It's just I saw a couple posts about this on rclone threads on Reddit and I saw rclone mentioned quite a bbit on the website so I guess my dumb monkey brain just automatically assumed it's a dedicated rclone client
Fair enough, speaking of Rclone, are there any specific back-ends you are mostly interested about?
Avatar
Nothing in particular really, I use a bunch of em, Google Drive, Box, OneDrive, OneDrive (Sharepoint), Mega I was just looking for a client that is able to show quick thumbnails for images and videos without grinding to a halt on large files because that is what happens when I mount a remote as a drive and view the thumbnails
8:14 AM
Especially for large video files
8:15 AM
While Windows Explorer is trying to generate a thumbnail for it, it grinds to a halt until the video finishes downloading completely which is also not ideal since the whole point of using rclone mount is to save on disk space
Avatar
Avatar
pizzabed
Nothing in particular really, I use a bunch of em, Google Drive, Box, OneDrive, OneDrive (Sharepoint), Mega I was just looking for a client that is able to show quick thumbnails for images and videos without grinding to a halt on large files because that is what happens when I mount a remote as a drive and view the thumbnails
Got it, thanks. We'll keep that in mind, so we can implement efficient thumbnails for images/videos including encrypted resources. That work is partially there for S3 back-ends, but still requires some improvements (encrypted videos aren't supported and thumbnail sizes could be dynamic + stored as an object on the back-end, so other clients can retrieve it). Speaking of Rclone, streaming interface is the first thing we will have to build (edited)
👍 1
Avatar
Would E2E encryption be synthetic for every my devices when I login
Avatar
Avatar
mix9311
Would E2E encryption be synthetic for every my devices when I login
I guess something was lost in translation. E2E encryption is managed separately on each your device, we don't manage your encryption password. That detail stays solely at your discretion.
aednichols joined the server. 5/19/2024 7:04 PM
Shen joined the server. 5/20/2024 6:44 AM
Avatar
@Tom Hello! Question about using it on Android. When setting up synchronization of individual folders, is it possible to make sure that they are synchronized only if Wifi is available? Mobile traffic is much more expensive and I would like to synchronize files only within the Wi-Fi coverage area (edited)
Avatar
Avatar
Nitrotoluol
@Tom Hello! Question about using it on Android. When setting up synchronization of individual folders, is it possible to make sure that they are synchronized only if Wifi is available? Mobile traffic is much more expensive and I would like to synchronize files only within the Wi-Fi coverage area (edited)
Hi, it's not yet possible, but it's on our feature list: https://s3drive.canny.io/feature-requests/p/add-sync-constraints-wifi-battery-charger
korayem joined the server. 5/20/2024 1:07 PM
Xeeaxe joined the server. 5/21/2024 9:25 PM
Giles joined the server. 5/23/2024 4:33 PM
Charissa joined the server. 5/23/2024 11:47 PM
Avatar
Deleted User 5/25/2024 4:03 AM
Hi Tom. I changed s3 provider recently and tried to login but received the following error: "Login: XmlTagException: Expected </hr>, but found </body>" The provider I currently using is hcm.s3storage.vn. Do you know what might cause it?
Avatar
Avatar
Deleted User
Hi Tom. I changed s3 provider recently and tried to login but received the following error: "Login: XmlTagException: Expected </hr>, but found </body>" The provider I currently using is hcm.s3storage.vn. Do you know what might cause it?
It's probably this endpoint responded with HTML instead of valid S3 XML. By any chance do you have any test credentials (feel free to PM me) that I could use? I would be happy to try it out and let you know in more detail. Thanks !
👍 1
Avatar
Avatar
Deleted User
Hi Tom. I changed s3 provider recently and tried to login but received the following error: "Login: XmlTagException: Expected </hr>, but found </body>" The provider I currently using is hcm.s3storage.vn. Do you know what might cause it?
Right, so I've got something. In order to validate whether credentials are fine we perform a read check on a some chosen non-existing key. S3 compliant provider shall return error code: NoSuchKey using XML format. hcm.s3storage.vn on the other hand returns invalid error code (500 instead of 4xx) and invalid format, HTML instead of XML: Server: HyperCoreS3 <html> <head><title>500 Internal Server Error</title></head> <body> <center><h1>500 Internal Server Error</h1></center> <hr><center>openresty/1.15.8.3</center> </body> </html> Once I've skipped the S3Drive read check (not possible currently from the app itself) I've actually managed to run couple actions, that is, list, copy/rename, delete. ... so there are two non-exclusive solutions. 1. Contact: hcm.s3storage.vn so they can fix the issue with their S3 API and make it compliant with the standard. 2. S3Drive to allow user to skip the read check <--- this is something we would be willing to allow, but it would take use a while, as we're busy with other work at the moment.
Lukky974 joined the server. 5/25/2024 6:48 PM
fancypantspatches joined the server. 5/25/2024 7:17 PM
9:35 PM
Every time I try to upload a large file, it errors?
9:35 PM
9:35 PM
I have nothing else open at all
Avatar
Avatar
Tom
Right, so I've got something. In order to validate whether credentials are fine we perform a read check on a some chosen non-existing key. S3 compliant provider shall return error code: NoSuchKey using XML format. hcm.s3storage.vn on the other hand returns invalid error code (500 instead of 4xx) and invalid format, HTML instead of XML: Server: HyperCoreS3 <html> <head><title>500 Internal Server Error</title></head> <body> <center><h1>500 Internal Server Error</h1></center> <hr><center>openresty/1.15.8.3</center> </body> </html> Once I've skipped the S3Drive read check (not possible currently from the app itself) I've actually managed to run couple actions, that is, list, copy/rename, delete. ... so there are two non-exclusive solutions. 1. Contact: hcm.s3storage.vn so they can fix the issue with their S3 API and make it compliant with the standard. 2. S3Drive to allow user to skip the read check <--- this is something we would be willing to allow, but it would take use a while, as we're busy with other work at the moment.
Deleted User 5/26/2024 1:24 AM
Thank you for your great support. I contacted my provider and they were able to provide the fix. Now I can login normally using S3Drive.
👌 2
Giles joined the server. 5/26/2024 11:53 AM
Deleted User joined the server. 5/26/2024 12:01 PM
ElGato joined the server. 5/26/2024 12:02 PM
Avatar
Avatar
CubityFirst
Every time I try to upload a large file, it errors?
What's your OS? How do you upload these files, is it + icon file upload, folder upload drag&drop upload or anything else? Do you happen to know at what threshold (file size) problem starts? Do you use E2E encryption? Do you use multipart uploads (configurable in the settings)? Does the transfer of these files start at all? Before it fails, does the progress halt or it keeps going until it fails eventually? Do you have any antivirus software on your machine? Do you have any non-standard firewall on your network or your traffic is routed through some proxy? Finally, what's your broadband type and speed? If you don't mind feel free to PM me what's your country (if you think there maybe some relevance or you've faced similar issue in the past for other endpoints / software) I would appreciate if you could give us some of these details as it may help us to trace down the problem. Thanks ! (edited)
Avatar
Avatar
Tom
What's your OS? How do you upload these files, is it + icon file upload, folder upload drag&drop upload or anything else? Do you happen to know at what threshold (file size) problem starts? Do you use E2E encryption? Do you use multipart uploads (configurable in the settings)? Does the transfer of these files start at all? Before it fails, does the progress halt or it keeps going until it fails eventually? Do you have any antivirus software on your machine? Do you have any non-standard firewall on your network or your traffic is routed through some proxy? Finally, what's your broadband type and speed? If you don't mind feel free to PM me what's your country (if you think there maybe some relevance or you've faced similar issue in the past for other endpoints / software) I would appreciate if you could give us some of these details as it may help us to trace down the problem. Thanks ! (edited)
Thanks for the questions. I'll check and answer all of these in the morning
rrawb joined the server. 5/27/2024 2:13 AM
Avatar
Avatar
rrawb
Click to see original message
Avatar
@rrawb Hi there !
Avatar
Avatar
Tom
What's your OS? How do you upload these files, is it + icon file upload, folder upload drag&drop upload or anything else? Do you happen to know at what threshold (file size) problem starts? Do you use E2E encryption? Do you use multipart uploads (configurable in the settings)? Does the transfer of these files start at all? Before it fails, does the progress halt or it keeps going until it fails eventually? Do you have any antivirus software on your machine? Do you have any non-standard firewall on your network or your traffic is routed through some proxy? Finally, what's your broadband type and speed? If you don't mind feel free to PM me what's your country (if you think there maybe some relevance or you've faced similar issue in the past for other endpoints / software) I would appreciate if you could give us some of these details as it may help us to trace down the problem. Thanks ! (edited)
Multipart Upload might have fixed this
11:49 AM
I didn't know that it would be off by default
Avatar
Avatar
CubityFirst
I didn't know that it would be off by default
It's off by default, because even though it improves upload resilience it usually slows down the overall speed because chunk upload is sequential at the moment. (edited)
Avatar
Avatar
Tom
It's off by default, because even though it improves upload resilience it usually slows down the overall speed because chunk upload is sequential at the moment. (edited)
Is there any chance to have a custom limit / different limit as to where multipart engages as opposed to not?
11:54 AM
R2 requires files above 4.995GiB to be uploaded as multi-part files, but anything below that doesn't matter
11:55 AM
I can see that S3 Drive deals with it as any file >100MB
Avatar
Avatar
CubityFirst
Is there any chance to have a custom limit / different limit as to where multipart engages as opposed to not?
I've added a feature reuqest: https://s3drive.canny.io/feature-requests/p/multipart-threshold-configuration There will be 2 configurable params. Can't give any ETA, but it's not a big deal, so likely within a month or two it should land in a production release. (edited)
❤️ 2
👌 1
Avatar
Thanks Tom, appreciate it
Avatar
@Tom Can I install on my iPhone and share app so Family can benefit using S3Drive & Media Backup? Is there any guidance on setting up please or just use same Key and endpoint for my S3 Bucket? Thank you
Avatar
Avatar
Giles
@Tom Can I install on my iPhone and share app so Family can benefit using S3Drive & Media Backup? Is there any guidance on setting up please or just use same Key and endpoint for my S3 Bucket? Thank you
Hi, Thanks for your message. It all depends. In principle you would generate a separate API key for each family member regardless if it points to the same bucket or a different one. Such approach is usually better from a security point of view. Question is if you would like to have a single bucket available to each family member, separate buckets or some combination of shared and separate buckets. We plan to introduce family plans and more granular sharing / folder exchange between separate accounts, so by default information is private and you as a user / family member decide what folder would you like to share (for read or write or both)... however it's a work in progress.
Avatar
Avatar
Giles
@Tom Can I install on my iPhone and share app so Family can benefit using S3Drive & Media Backup? Is there any guidance on setting up please or just use same Key and endpoint for my S3 Bucket? Thank you
Speaking of media backup setup, we don't have a guide as such, but it shouldn't be that hard. Initially you'll need to give permission to your media files (either all or some subset you can select), then you'd need to select albums that S3Drive would then upload. You might want tweak the upload path in the settings (by default it uploads to the Automatic Uploads/<phoneModel>) if by any chance you've set up same bucket for photo for all family members, you might want to double check upload path so there is no "name collision" if for instance you use two exactly same iPhone models. (edited)
Avatar
Avatar
Giles
@Tom Can I install on my iPhone and share app so Family can benefit using S3Drive & Media Backup? Is there any guidance on setting up please or just use same Key and endpoint for my S3 Bucket? Thank you
If you have any specific problem with setting things up or more of a general question, I am happy to help out ! (edited)
Avatar
Avatar
Tom
Hi, Thanks for your message. It all depends. In principle you would generate a separate API key for each family member regardless if it points to the same bucket or a different one. Such approach is usually better from a security point of view. Question is if you would like to have a single bucket available to each family member, separate buckets or some combination of shared and separate buckets. We plan to introduce family plans and more granular sharing / folder exchange between separate accounts, so by default information is private and you as a user / family member decide what folder would you like to share (for read or write or both)... however it's a work in progress.
Thank you Tom. We have one shared bucket with multiple folders we can all access which is fine. I can create individual API Keys if that is best practice. I am trying to keep it simple for the family and myself! 😁
Avatar
Avatar
Tom
Speaking of media backup setup, we don't have a guide as such, but it shouldn't be that hard. Initially you'll need to give permission to your media files (either all or some subset you can select), then you'd need to select albums that S3Drive would then upload. You might want tweak the upload path in the settings (by default it uploads to the Automatic Uploads/<phoneModel>) if by any chance you've set up same bucket for photo for all family members, you might want to double check upload path so there is no "name collision" if for instance you use two exactly same iPhone models. (edited)
I’m looking to set up S3Drive with Media Backup for each family member. I have seen how this works from my device with the creation of folders, ‘Automatic Upload’ and then device model name, which I can rename. The issue is that having downloaded the app on my daughters mobile it is not starting the upload, even though full access has been given to the photo library and it is showing the count of photos (All) but it does not start uploading.
Avatar
Avatar
Tom
If you have any specific problem with setting things up or more of a general question, I am happy to help out ! (edited)
I have paid for the app for a month to test that this can work, as I think it should, ie in the background. I understood if I have paid for the app then via Apple family, my daughter would be able to download and benefit from the background upload but need to solve the initial issue of it not uploading any Media despite tapping ‘Start Upload’. Thank you for your help.
Avatar
Avatar
Giles
I have paid for the app for a month to test that this can work, as I think it should, ie in the background. I understood if I have paid for the app then via Apple family, my daughter would be able to download and benefit from the background upload but need to solve the initial issue of it not uploading any Media despite tapping ‘Start Upload’. Thank you for your help.
I do appreciate making a purchase and supporting the project. I assume that you've: "Backup when app starts" toggled on? In such case backup would start when app starts (or if app gets resumed), but it won't start automatically when apps run already (Start backup button needs to be tapped manually).
👍 1
Avatar
Avatar
Giles
I have paid for the app for a month to test that this can work, as I think it should, ie in the background. I understood if I have paid for the app then via Apple family, my daughter would be able to download and benefit from the background upload but need to solve the initial issue of it not uploading any Media despite tapping ‘Start Upload’. Thank you for your help.
Speaking of background mode, it's limited to default what iOS provides. Usually background backup would start if device is connected to charger and kept overnight. The issue is that background backup has limited execution time, so if you have plenty assets to backup it would certainly have to be executed multiple times in order for your assets to be fully uploaded. It might be more reliable to run the initial sync (foreground) and then rely on background backup to periodically sync the difference. (edited)
Avatar
Avatar
Tom
Speaking of background mode, it's limited to default what iOS provides. Usually background backup would start if device is connected to charger and kept overnight. The issue is that background backup has limited execution time, so if you have plenty assets to backup it would certainly have to be executed multiple times in order for your assets to be fully uploaded. It might be more reliable to run the initial sync (foreground) and then rely on background backup to periodically sync the difference. (edited)
Great. Understand re iOS background policy. Will try initial sync first then switch as you have explained. Thank you
Avatar
Avatar
Tom
Speaking of background mode, it's limited to default what iOS provides. Usually background backup would start if device is connected to charger and kept overnight. The issue is that background backup has limited execution time, so if you have plenty assets to backup it would certainly have to be executed multiple times in order for your assets to be fully uploaded. It might be more reliable to run the initial sync (foreground) and then rely on background backup to periodically sync the difference. (edited)
For clarity, once my daughter’s media has sync’d as you have explained, should the app on her iPhone allow Background backup to work, as I have purchased the app and it is shared via the Apple Family sharing option or not and we therefore need to purchase per iPhone? Thank you.
Uncle Remus joined the server. 5/27/2024 7:24 PM
Avatar
Avatar
Uncle Remus
Click to see original message
Avatar
Avatar
Giles
Great. Understand re iOS background policy. Will try initial sync first then switch as you have explained. Thank you
Just for the clarity, you would normally enable background backup, but you can (and probably should) leave the "Start sync when app starts" setting enabled.
👍 1
Avatar
Avatar
Giles
For clarity, once my daughter’s media has sync’d as you have explained, should the app on her iPhone allow Background backup to work, as I have purchased the app and it is shared via the Apple Family sharing option or not and we therefore need to purchase per iPhone? Thank you.
We haven't enabled Apple Family sharing, since it poses couple hard to solve challenges once we want to expand sharing experience to our other platforms (Android, PC etc.). We plan to implement family plans using our in-house billing and they will be available on all platforms (not just Apple) but it's not yet ready, so in principle at the moment you would need a separate license. The alternative would be to create an account on our website: https://s3drive.app/faq?q=website_vs_inapp and based on your existing I could enable Ultimate plan on it (feel free to DM me your e-mail, so I can enable the Ultimate monthly on it), then using such account you could login to S3Drive on your device and other family member only to obtain the Ultimate license. As such every user should use their own personal account (security wise mostly), but for license purposes it would work just fine... and we don't make any trouble if license is reused within family especially when we don't have any systematic way of handling this just yet.
hurricane joined the server. 5/28/2024 8:08 AM
Ollie N joined the server. 5/28/2024 10:51 PM
Laaaaa joined the server. 5/29/2024 11:40 AM
Avatar
InfiniteAds559 5/29/2024 7:58 PM
Setting up CORS on mobile phone using BackBlaze (Already setup CORS here) states "Failed: entitled header"
Avatar
InfiniteAds559 5/29/2024 8:28 PM
Is there a step I'm missing?
toddletoon joined the server. 5/30/2024 5:44 AM
Avatar
Avatar
InfiniteAds559
Is there a step I'm missing?
Hi, please find our Backblaze specific guide: https://docs.s3drive.app/setup/bucket/#set-up-an-api-key There is a prompt/warning stating that in order to set up CORS, the API key requires access to "All" buckets. It's some quirk on the Backblaze side, but unfortunately that's how it works at the moment. (edited)
jt0103 joined the server. 5/30/2024 7:39 PM
Avatar
Avatar
Tom
Hi, please find our Backblaze specific guide: https://docs.s3drive.app/setup/bucket/#set-up-an-api-key There is a prompt/warning stating that in order to set up CORS, the API key requires access to "All" buckets. It's some quirk on the Backblaze side, but unfortunately that's how it works at the moment. (edited)
InfiniteAds559 5/30/2024 10:16 PM
Yea, I've followed the guide and I'm still getting the same error. I also made a test-bucket and a new app key with require access to "All" per the image below and still the same. Using Brave Browser if that makes a difference. (edited)
Avatar
@InfiniteAds559 Are you trying to "Set up CORS" using desktop, mobile or web S3Drive client? I've did a quick test where I've created new API key with access to all buckets then created a new bucket and then used: "Set up CORS" in the settings menu which worked well. I've then set back CORS to default and tried again on Web, the flow is different with CORS prompt appearing at the bottom during login, but nevertheless it worked just fine. Speaking of CORS setup directly from the Backblaze page, I honestly can say I've never made it work regardless of chosen option, so I can't assist you on that. Please find the attached screenshots. Do you still get: "not entitled" error with the newly generated API key? (edited)
6:47 AM
Avatar
Avatar
Tom
@InfiniteAds559 Are you trying to "Set up CORS" using desktop, mobile or web S3Drive client? I've did a quick test where I've created new API key with access to all buckets then created a new bucket and then used: "Set up CORS" in the settings menu which worked well. I've then set back CORS to default and tried again on Web, the flow is different with CORS prompt appearing at the bottom during login, but nevertheless it worked just fine. Speaking of CORS setup directly from the Backblaze page, I honestly can say I've never made it work regardless of chosen option, so I can't assist you on that. Please find the attached screenshots. Do you still get: "not entitled" error with the newly generated API key? (edited)
InfiniteAds559 5/31/2024 2:04 PM
So it seems that the "CORS Rules" was messing up with the set up since I enabled share everything in this bucket. And since the instructions said to set up CORS rules in the admin panel meant literally "CORS Rules" tab. It's working now. Meanwhile, I'm testing the desktop app but it takes a while to load (I had to force quit the app multiple times)
mattyward2k joined the server. 6/1/2024 11:41 AM
Avatar
Avatar
InfiniteAds559
So it seems that the "CORS Rules" was messing up with the set up since I enabled share everything in this bucket. And since the instructions said to set up CORS rules in the admin panel meant literally "CORS Rules" tab. It's working now. Meanwhile, I'm testing the desktop app but it takes a while to load (I had to force quit the app multiple times)
How it's going with the desktop app? Does it still not load properly? If you have some more details, please send us some more details in the #support channel, so we can have a look. Thanks
Avatar
I have to use cyberduck to upload files more than 1GB to avoid OS errors every time instead of S3Drive
5:38 PM
I feel so sad to do that.
5:40 PM
E2E encryption is much more different from SSE-S3(AES-256) or SSE-KMS method. I had to switch back and forth.. (edited)
5:41 PM
OS error: The remote host has forced the closure of an existing connection. (edited)
Avatar
Yes uploaded success in cyberduck.
Avatar
InfiniteAds559 6/2/2024 6:14 PM
I'm having a difficulty uploading >100MB files in both Android & desktop. "Invalid argument. Invalid array length"
Avatar
Avatar
mix9311
I have to use cyberduck to upload files more than 1GB to avoid OS errors every time instead of S3Drive
Bear with us, we're in the process of implementing "Upload retry on error", but before we roll it out we really want to make sure that any other obstacles are resolved first to avoid pointless repeated upload and wasting resources. Does the upload fail immediately or at some point e..g on 1/3 progress?
Avatar
Avatar
mix9311
E2E encryption is much more different from SSE-S3(AES-256) or SSE-KMS method. I had to switch back and forth.. (edited)
Do you have any issue with E2E encryption? SSE-S3(AES-256) or SSE-KMS are Server Side Encryptions managed by AWS. It's transparent to the user and encryption happens on the AWS server. It's better than nothing, but it ranks pretty low from a privacy point of view, since S3 provider can see file contents at their discretion.
Avatar
Avatar
InfiniteAds559
I'm having a difficulty uploading >100MB files in both Android & desktop. "Invalid argument. Invalid array length"
Does it refer to: "Upload files" functionality? Can you try changing Multipart (either disable or enable) in the settings and see if it helps?
Avatar
Avatar
Tom
Bear with us, we're in the process of implementing "Upload retry on error", but before we roll it out we really want to make sure that any other obstacles are resolved first to avoid pointless repeated upload and wasting resources. Does the upload fail immediately or at some point e..g on 1/3 progress?
no just at the beginning
Avatar
Avatar
Tom
Does it refer to: "Upload files" functionality? Can you try changing Multipart (either disable or enable) in the settings and see if it helps?
Disable and enable tires lot of times
7:02 PM
no helps to backblaze
Avatar
Avatar
Tom
Do you have any issue with E2E encryption? SSE-S3(AES-256) or SSE-KMS are Server Side Encryptions managed by AWS. It's transparent to the user and encryption happens on the AWS server. It's better than nothing, but it ranks pretty low from a privacy point of view, since S3 provider can see file contents at their discretion.
No ,just because your s3drive cannot upload size more than 1GB on backblaze ,So I have to upload using cyberduck with SSE-S3 encryption ,In this case my files are being seen and I can't help it because of your upload errors all the time.
Avatar
Avatar
mix9311
No ,just because your s3drive cannot upload size more than 1GB on backblaze ,So I have to upload using cyberduck with SSE-S3 encryption ,In this case my files are being seen and I can't help it because of your upload errors all the time.
I understand, do you have multipart upload enabled or disabled?
Avatar
I'd just opened backblaze SSE-B2 also cyberduck SSE-S3 encryption there when uploading ,what would happen to my files ??
7:07 PM
disabled current time
7:11 PM
when enabled multipart upload error like this: timeoutException after 0:00:20.000000:Future not completed....
7:11 PM
Whatever it's on or off,failed all the time.
7:15 PM
When using Server-Side Encryption with Amazon S3-Managed Keys (SSE-S3), Amazon S3 encrypts your data as it writes it to disks in their data centers and decrypts it for you when you access it. Amazon S3 manages the encryption keys and uses one of the strongest block ciphers available, 256-bit Advanced Encryption Standard (AES-256)1. However, it’s important to note that while SSE-S3 provides a high level of security by encrypting the data at rest, the S3 service itself can access the encrypted files. This is because the encryption and decryption are handled server-side by Amazon S3. For instance, when you request an object, Amazon S3 decrypts the object before returning it to you2. So, while others cannot see your files without proper authentication and authorization, the S3 service, as the provider, can technically access the encrypted files, although AWS has strict policies and controls in place to protect customer data3. If you require a higher level of control over the encryption keys, you might consider using Server-Side Encryption with AWS Key Management Service (SSE-KMS) or Server-Side Encryption with Customer-Provided Keys (SSE-C), which provide different levels of control and audit capability2.
7:16 PM
So SSE-KMS is more safe anyway?I did not see SSE-C on cyberduck options
Avatar
Avatar
Tom
Does it refer to: "Upload files" functionality? Can you try changing Multipart (either disable or enable) in the settings and see if it helps?
InfiniteAds559 6/2/2024 7:46 PM
I've tried both, but still the same error. I kept retrying and one file uploaded successfully, but this one 300MB file won't. Moreover, even select photos won't upload
Avatar
Avatar
mix9311
So SSE-KMS is more safe anyway?I did not see SSE-C on cyberduck options
Both SSE-KMS or SSE-C are server side encryption methods. I wouldn't use SSE-C, why bother manging key and risk losing it if there isn't apparent security benefit, since you're sending key (leaking security context) to the S3 provider anyway.
Avatar
what's a Time information on backblaze settings:
Avatar
InfiniteAds559 6/2/2024 9:09 PM
Another thing is I use a vpn+firewall, and it often disconnects my vpn when browsing S3drive. I'm looking at the logs and there aren't any block connections
cobra joined the server. 6/2/2024 11:21 PM
BrightSavanna joined the server. 6/3/2024 12:57 AM
Avatar
Avatar
mix9311
what's a Time information on backblaze settings:
You can find some information in their docs: https://www.backblaze.com/apidocs/b2-update-bucket -> bucketInfo and https://www.backblaze.com/docs/cloud-storage-buckets -> Bucket Information
You can add key/value pairs as custom information associated with the bucket. [...] You can also set the cache-control policy for buckets. For example, if you want the client to cache files for five minutes, you add a name/value pair such as "Cache-Control" : "max-age=600"
(edited)
anthony joined the server. 6/3/2024 7:06 PM
Avatar
Avatar
Tom
You can find some information in their docs: https://www.backblaze.com/apidocs/b2-update-bucket -> bucketInfo and https://www.backblaze.com/docs/cloud-storage-buckets -> Bucket Information
You can add key/value pairs as custom information associated with the bucket. [...] You can also set the cache-control policy for buckets. For example, if you want the client to cache files for five minutes, you add a name/value pair such as "Cache-Control" : "max-age=600"
(edited)
Does max age larger better ??
Avatar
Avatar
mix9311
Does max age larger better ??
If you're not sure about the consequences of that setting then you can safely keep the defaults. (edited)
3yb joined the server. 6/4/2024 6:58 PM
Avatar
Hi @Tom , thanks for creating this fantastic apps and services. I'm curios to know, if there is any company behind all this or if you are working as an freelancer. Also I would like to know which data is stored, especially if I have an account with my s3 logins and everything stored. I cannot find any Impressum on your page, which I thought is mandatory for doing business in the EU, so that's why I'm asking all this here
Avatar
Hi @Currypaul, Since at the moment we're just selling software licenses we're running somewhat simplified setup. Company is registered under my name, you can find its details in the respective app store or when you make a purchase (on the invoice). We're in the process of registering a legal entity which will then formally own the software and sell the storage. We'll then update our website to include all of the required company details, as well as some other necessary details (e.g. GDPR Data Protection Officer etc.) Regarding data processing you can find our privacy policy here: https://s3drive.app/privacy Your S3 logins are stored on your device, we're not transferring them or synchronizing between devices. On most platforms they're encrypted using available built-in OS tools (e.g. Keychain). If you have any other questions regarding how we operate as a company and/or software, or have some specific questions regarding how data is stored / encrypted, I would be more than happy to answer. (edited)
👍 1
B.B.M joined the server. 6/5/2024 12:55 PM
Avatar
Avatar
B.B.M
Click to see original message
Avatar
I would strongly like to urge that old s3drive versions do not expire. It's fine to have nag screens on every launch informing the user of the latest version, but had I waited any longer to use s3drive again, I would have been locked out of doing so because of a bug that was introduced not even 2 weeks ago
Avatar
Avatar
Tom
Hi @Currypaul, Since at the moment we're just selling software licenses we're running somewhat simplified setup. Company is registered under my name, you can find its details in the respective app store or when you make a purchase (on the invoice). We're in the process of registering a legal entity which will then formally own the software and sell the storage. We'll then update our website to include all of the required company details, as well as some other necessary details (e.g. GDPR Data Protection Officer etc.) Regarding data processing you can find our privacy policy here: https://s3drive.app/privacy Your S3 logins are stored on your device, we're not transferring them or synchronizing between devices. On most platforms they're encrypted using available built-in OS tools (e.g. Keychain). If you have any other questions regarding how we operate as a company and/or software, or have some specific questions regarding how data is stored / encrypted, I would be more than happy to answer. (edited)
Thanks for making that clear. I thin I know now what I need to know for data protection and private use. I just wanted to test the rclone features, especially the encryption. For this I need more than one account, as I need to set up the S3 service first and then the encryption service for that S3 server. So I definitely hit the limit of only one account. Is it possible to have an testaccount for a month? Another way could be to do pay via paypal. I really don't like to put creditcard data to every provider 😕
Avatar
Avatar
Currypaul
Thanks for making that clear. I thin I know now what I need to know for data protection and private use. I just wanted to test the rclone features, especially the encryption. For this I need more than one account, as I need to set up the S3 service first and then the encryption service for that S3 server. So I definitely hit the limit of only one account. Is it possible to have an testaccount for a month? Another way could be to do pay via paypal. I really don't like to put creditcard data to every provider 😕
Sure, please register an account and then click Join (that's required so the account gets transferred to billing system, but you can close it straightaway) on our pricing page: https://s3drive.app/pricing afterwards feel free to PM me, so I can enable test Ultimate on your account. Regarding payments, we're not handling your CC details directly through our system, but offload that to Stripe (they have relevant PCI certificate). What we get back is cryptographically signed payment confirmation. I still understand that not everyone feels comfortable giving out CC data. (edited)
👍 1
w0lfvn joined the server. 6/6/2024 8:05 AM
Avatar
Deleted User 6/6/2024 2:45 PM
Any updated on how to connect koofr vault and s3 drive ?
2:45 PM
Or WebDAV with koofr vault
Avatar
Avatar
Deleted User
Any updated on how to connect koofr vault and s3 drive ?
Please find this topic: https://discord.com/channels/1069654792902815845/1225178242873298994 Set up isn't entirely automated, but it's doable and proven to work. Please give it a go and if you're stuck we can assist. Thanks !
juanlucer joined the server. 6/6/2024 4:01 PM
Avatar
Always saw different types of errors when uploading big files especially backblaze
re_ joined the server. 6/7/2024 2:12 AM
Avatar
Hi, i have some questions regarding the app: 1. Given that i am using the free personal plan, then i upgrade and use ultimate plan (with the same s3 bucket), will it compatible? 2. With ultimate plan, can i use on multiple devices, each setup with one or more different buckets? Does it have any limit or restriction on this? Thanks.
Avatar
Avatar
w0lfvn
Hi, i have some questions regarding the app: 1. Given that i am using the free personal plan, then i upgrade and use ultimate plan (with the same s3 bucket), will it compatible? 2. With ultimate plan, can i use on multiple devices, each setup with one or more different buckets? Does it have any limit or restriction on this? Thanks.
Yes, Ultimate plan is suitable for connecting to external S3 / Rclone endpoints. You can use it freely with all your devices as long as you login using email/password credentials (the ones to which the Ultimate license is tired) first and then switch to S3 / Rclone endpoint of your choice.
👍 1
qwertyy joined the server. 6/7/2024 4:53 PM
fookwon joined the server. 6/8/2024 10:43 PM
Virtram joined the server. 6/9/2024 5:20 PM
Michiel joined the server. 6/9/2024 8:29 PM
cbnalica joined the server. 6/9/2024 11:05 PM
Bituhh joined the server. 6/10/2024 6:03 AM
Avatar
Hi, I have upgrade both my android and my IPhone to the ultimate life time plan. While the device is backing up the photos etc. I notice that only one upload is done at a time. Is there an option or a feature that enables multiple uploads? I love the app and it's potential.
Avatar
Also background backup doesn't seem to be working right.
Avatar
Avatar
Bituhh
Hi, I have upgrade both my android and my IPhone to the ultimate life time plan. While the device is backing up the photos etc. I notice that only one upload is done at a time. Is there an option or a feature that enables multiple uploads? I love the app and it's potential.
Hi, Thank you for getting the Ultimate plan and supporting the project ! Concurrent file upload on mobile it's coming, the prototype is there, however we're still facing couple issues with the internals. We're somewhat dependent on these two issues https://github.com/talesbarreto/uri_content/issues/10#issuecomment-2155563121 or https://github.com/flutter/flutter/issues/119207#issuecomment-2123365554 They're likely to get resolved within couple next months if not sooner, in which case we would be able to push our improvements. Stay tuned. (edited)
Avatar
Avatar
Bituhh
Also background backup doesn't seem to be working right.
Speaking of background backup do you refer to iOS or Android? On iOS its abilities are somewhat limited, on Android in principle it shall work fine for any external S3 or Rclone.
Avatar
iOS mainly. The issue is when I minimise the app. I expect it to be uploading on the background, what would be the limitations in this case?
Avatar
Avatar
Bituhh
iOS mainly. The issue is when I minimise the app. I expect it to be uploading on the background, what would be the limitations in this case?
The biggest limitation comes from the OS itself, which doesn't really trigger the background job unless device it's connected to charger, fully charged and left for quite a while, which usually happens overnight. Once it runs the background time is limited which proves difficult to upload bigger files or finish uploading multiple files in one go. There are some improvements we will be doing, (e.g. allow upload pause/resume), so gradually even with limited background time it could eventually finish. The other bit is that there are some iOS specific tricks that can be done in order to squeeze more background time from the system. We'll be exploring these.
Avatar
I see thank you very much. Love the project. I am an nodejs developer and have touched flutter very briefly a while back. If you every need any support with anything feel free to reach out.
👍 1
matrizxc joined the server. 6/10/2024 1:19 PM
Avatar
Unlawful Cactus 6/10/2024 1:38 PM
Time for my monthly check-in 😉 The app is running smoothly on my Android, just waiting for the full background sync functionality + writable mounts. I found some minor typos/text issues:
  • know: the whole word seems superfluous
  • report: the plural—reports—seems more fitting, but that might just be opinion
  • Thanks !: the space seems unnecessary
1:43 PM
Ah, I get where that 'know' came from, a mixup of "we will notify you" and "we will let you know". Those brains of ours... fairly reliable but there's always the occasional hiccup 😄
andy joined the server. 6/10/2024 4:18 PM
Avatar
Avatar
Unlawful Cactus
Time for my monthly check-in 😉 The app is running smoothly on my Android, just waiting for the full background sync functionality + writable mounts. I found some minor typos/text issues:
  • know: the whole word seems superfluous
  • report: the plural—reports—seems more fitting, but that might just be opinion
  • Thanks !: the space seems unnecessary
Thanks for the heads up. We'll have it sorted in a next release. Speaking of exclamation mark, it's fun to learn, that I was actually using French notation, which isn't correct in English. I was 100% sure that this is the only right way... will take me a while to get used to the new notation! Speaking of these two features, writable mounts will likely happen first, since it's somewhat predictable task to implement resource wise. Can't give any close ETA though, possibly Q4. Background processing is always tricky to deal with, but it will come eventually. We'll need to improve resilience of multipart uploads and failure retries first, as this is crucial to get right in a resource constrained background environment. (edited)
❤️ 1
Avatar
Unlawful Cactus 6/10/2024 7:18 PM
O wow, that's interesting! I don't remember that from my French classes as a teenager. Then again, I presume there's a lot I was supposed to learn in school that I didn't retain 😅 There's no objective right way of course, only consensus and consistency. Maybe if the "Are you sure?" also had a space before the punctuation mark, I wouldn't have said anything 😄 Cheers!
Datura joined the server. 6/11/2024 5:20 PM
kp90 joined the server. 6/11/2024 8:45 PM
joaotome1994 joined the server. 6/11/2024 10:57 PM
Arwen joined the server. 6/14/2024 9:12 PM
Garder500 joined the server. 6/16/2024 10:38 PM
Judge joined the server. 6/17/2024 1:44 AM
Froshk joined the server. 6/17/2024 4:36 AM
Doug Niccum joined the server. 6/19/2024 2:25 AM
qinghong67 joined the server. 6/20/2024 8:44 AM
StillFigurin joined the server. 6/21/2024 2:40 PM
StillFigurin joined the server. 6/21/2024 2:41 PM
RTB joined the server. 6/21/2024 7:29 PM
hragon joined the server. 6/25/2024 12:36 PM
Salt joined the server. 6/25/2024 6:28 PM
Avatar
Hey, I'm new to all of this and had a few questions to S3Drive and rclone I am using Proton Drive as my main Cloud, but it always bugged me that on-the-go playback was never possible on larger files. After searching around, I found S3Drive. Since it said it has the possibility to play videos without downloading them, I decided to give it a go. Now I've managed to install S3Drive with rclone onto my machine and connected it with my Proton Drive. Afterwards I clicked on "start mounting" within the client and it created a new network folder in my Windows Explorer. This new drive seems to be able to play videos on-the-go since it buffers before it plays in my video player (please correct me if I'm wrong). Furthermore I am wondering if my files still are secure, private and encrypted by Proton,.. are they when I access them via the new folder? Thanks and sorry again, total noob here ;-; tl;dr Are the files I playback from the mounted drive (S3Drive mounted drive which gets the files through my connected rclone>ProtonDrive connection) stored locally/take up space on my machine after they finish playing? Are the files from the mounted drive still encryped/secure once I connected Proton Drive with rclone?
Avatar
Avatar
Salt
Hey, I'm new to all of this and had a few questions to S3Drive and rclone I am using Proton Drive as my main Cloud, but it always bugged me that on-the-go playback was never possible on larger files. After searching around, I found S3Drive. Since it said it has the possibility to play videos without downloading them, I decided to give it a go. Now I've managed to install S3Drive with rclone onto my machine and connected it with my Proton Drive. Afterwards I clicked on "start mounting" within the client and it created a new network folder in my Windows Explorer. This new drive seems to be able to play videos on-the-go since it buffers before it plays in my video player (please correct me if I'm wrong). Furthermore I am wondering if my files still are secure, private and encrypted by Proton,.. are they when I access them via the new folder? Thanks and sorry again, total noob here ;-; tl;dr Are the files I playback from the mounted drive (S3Drive mounted drive which gets the files through my connected rclone>ProtonDrive connection) stored locally/take up space on my machine after they finish playing? Are the files from the mounted drive still encryped/secure once I connected Proton Drive with rclone?
Hi @Salt and welcome to our little World. Streaming on your mounted drive is possible, because Rclone itself (we use it internally) supports content streaming from various back-ends and at the same time supports Proton encryption. Streaming itself doesn't pose security risks, on the contrary, it might actually be a safer option (vs downloading whole file), that is because with streaming file isn't decrypted and saved to disk as a whole. Instead, only sequential chunks are encrypted whereas used/watched ones get discarded. Streaming encrypted media isn't inherently different to streaming unencrypted media. There is just one additional step in the middle, that is decrypting flow of encrypted bytes in to something that video player can understand. In-app streaming (not through mount) of encrypted video in S3Drive is currently supported for S3 protocol, but not for Rclone back-end (Proton included). We will add support for in-app streaming, formally added feature request: https://s3drive.canny.io/feature-requests/p/implement-video-streaming-for-rclone-back-ends to track it.
Avatar
Avatar
Salt
Hey, I'm new to all of this and had a few questions to S3Drive and rclone I am using Proton Drive as my main Cloud, but it always bugged me that on-the-go playback was never possible on larger files. After searching around, I found S3Drive. Since it said it has the possibility to play videos without downloading them, I decided to give it a go. Now I've managed to install S3Drive with rclone onto my machine and connected it with my Proton Drive. Afterwards I clicked on "start mounting" within the client and it created a new network folder in my Windows Explorer. This new drive seems to be able to play videos on-the-go since it buffers before it plays in my video player (please correct me if I'm wrong). Furthermore I am wondering if my files still are secure, private and encrypted by Proton,.. are they when I access them via the new folder? Thanks and sorry again, total noob here ;-; tl;dr Are the files I playback from the mounted drive (S3Drive mounted drive which gets the files through my connected rclone>ProtonDrive connection) stored locally/take up space on my machine after they finish playing? Are the files from the mounted drive still encryped/secure once I connected Proton Drive with rclone?
Speaking of security and potential risk vectors that you should be aware of. Below actions are optional, but might further improve security. a) You may want to disable VFS mount cache in the S3Drive settings, so no file cache is written to disk. b) You may want to remove your username and password from the Rclone configuration after setting up Proton, please see my comment here: https://www.reddit.com/r/ProtonMail/comments/18s211d/comment/kzfqub7/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button I haven't used that myself long enough, it may happen that at some point username and password will be required for the resetup if by any chance: client_refresh_token expires. In the future we will allow password striping in-app, so no manual step is required. c) In general you may monitor any undesired file access to config file, on Windows: C:\Users\<user>\AppData\Roaming\rclone\rclone.conf, as this is where sensitive data is stored. In the future we will support Rclone encrypted config: https://rclone.org/docs/#configuration-encryption (edited)
Avatar
Avatar
Tom
Hi @Salt and welcome to our little World. Streaming on your mounted drive is possible, because Rclone itself (we use it internally) supports content streaming from various back-ends and at the same time supports Proton encryption. Streaming itself doesn't pose security risks, on the contrary, it might actually be a safer option (vs downloading whole file), that is because with streaming file isn't decrypted and saved to disk as a whole. Instead, only sequential chunks are encrypted whereas used/watched ones get discarded. Streaming encrypted media isn't inherently different to streaming unencrypted media. There is just one additional step in the middle, that is decrypting flow of encrypted bytes in to something that video player can understand. In-app streaming (not through mount) of encrypted video in S3Drive is currently supported for S3 protocol, but not for Rclone back-end (Proton included). We will add support for in-app streaming, formally added feature request: https://s3drive.canny.io/feature-requests/p/implement-video-streaming-for-rclone-back-ends to track it.
Thank you so much! Very thorough answers : ) One quick follow-up question: I am confused as to where the S3Drive mount lies. Like, it is listed as an online fileserver on my explorer, but where on my network does it lie? And does it have to be instantiated every time i restart my machine?
Avatar
Avatar
Salt
Thank you so much! Very thorough answers : ) One quick follow-up question: I am confused as to where the S3Drive mount lies. Like, it is listed as an online fileserver on my explorer, but where on my network does it lie? And does it have to be instantiated every time i restart my machine?
Currently it does create network share with a local letter e.g. Z: and remote handle, eg. \\server\s3drive_proton. In 1.9.2 version which is available as pre-release (and will be released to general public in a few days): https://github.com/s3drive/windows-app/releases/tag/1.9.2 we've added an option to disable network (and made it default setting) mount in case you don't want to share it. In order to start mount after reboot, you can use combination of: "Launch app at startup" and then: "Mount drive after app starts". In the future we will add an option to start the app in tray: https://s3drive.canny.io/feature-requests/p/desktop-app-minimize-to-tray-dont-close so S3Drive windows doesn't pop up each time. (edited)
Avatar
Avatar
Salt
Thank you so much! Very thorough answers : ) One quick follow-up question: I am confused as to where the S3Drive mount lies. Like, it is listed as an online fileserver on my explorer, but where on my network does it lie? And does it have to be instantiated every time i restart my machine?
This is to let you know that in our main Windows release: https://github.com/s3drive/windows-app/releases you can toggle on/off network sharing. By default mount will end up in your File Explorer, but it won't be available on your network.
Avatar
Avatar
Tom
This is to let you know that in our main Windows release: https://github.com/s3drive/windows-app/releases you can toggle on/off network sharing. By default mount will end up in your File Explorer, but it won't be available on your network.
Oh man, thank you so so much! U're a hell of a dev for caring this much about your community ❣️
❤️ 1
Avatar
Tom is the GOAT :)
Avatar
Avatar
Xenthys
Tom is the GOAT :)
Well, thanks, my job is a hell lot easier if you guys provide such a great feedback. s3drive
corsair400r joined the server. 6/26/2024 2:17 PM
Avatar
Managed storage plans
Avatar
Avatar
corsair400r
Click to see original message
2:27 PM
Hi team, regarding this Managed storage plan (100GB, 500GB, 1TB, 5TB...) from the roadmap, are you planning to offer storage plans so we can pay you monthly, yearly and you will offer 1TB, 10TB, 30 TB, etc ? Am I understanding correctly?
Avatar
Avatar
corsair400r
Hi team, regarding this Managed storage plan (100GB, 500GB, 1TB, 5TB...) from the roadmap, are you planning to offer storage plans so we can pay you monthly, yearly and you will offer 1TB, 10TB, 30 TB, etc ? Am I understanding correctly?
That's right, it's all coming soon. The exact size distribution is to be confirmed, but we're likely provide stacking option, so you can combine plans. E.g. if you need 6TB, then 5TB + 1TB would be best option. What storage size would you suit you best?
gorbak25 joined the server. 6/26/2024 4:15 PM
Avatar
Avatar
kefir
Hi, I'm busy backing up my files to a remote s3 storage, in essence migrating away from Google photos. But I'm curious about the roadmap and the "Photo management tools" on the roadmap for 2024. I often search my media files by face recognition, by geographic location, and by date/time. How will that work with the planned s3drive features? Will a shared database/index be stored on s3, or will an index be local to a device? Will I have to re-index/process all files before they can be searched?
I think I've missed that one. We haven't made much progress on that. In the ideal scenario we would keep local state which could be then synced with other devices, with some periodic backup to S3. There are some projects which utilize S3 as a database, but given that there isn't proper locking mechanism is pretty hard to avoid corruption in the long-run. We haven't researched feasible options just yet. If you aim to replace Google Photos, you might try Ente project, these guys focus on photo management and support E2E. I haven't tried that project myself, but I've heard lots of positives. We will eventually catch up, but honestly not sure if we can make much progress on that this year. (edited)
Avatar
Avatar
Tom
I think I've missed that one. We haven't made much progress on that. In the ideal scenario we would keep local state which could be then synced with other devices, with some periodic backup to S3. There are some projects which utilize S3 as a database, but given that there isn't proper locking mechanism is pretty hard to avoid corruption in the long-run. We haven't researched feasible options just yet. If you aim to replace Google Photos, you might try Ente project, these guys focus on photo management and support E2E. I haven't tried that project myself, but I've heard lots of positives. We will eventually catch up, but honestly not sure if we can make much progress on that this year. (edited)
Thanks for the suggestion, I'll look into it!
Chris Glaser joined the server. 6/27/2024 6:47 AM
Avatar
Avatar
Tom
That's right, it's all coming soon. The exact size distribution is to be confirmed, but we're likely provide stacking option, so you can combine plans. E.g. if you need 6TB, then 5TB + 1TB would be best option. What storage size would you suit you best?
Hi Tom, I am interested in at least 10 TB to start with and then maybe 10TB each year
Avatar
Chris Glaser 6/27/2024 6:53 AM
Hello I'm trying to upload some video files to the S3 Drive. However, every time I try I get an error message in gobbledygook that I don't understand. Anyone have any ideas about what's going wrong? Chris
Avatar
Avatar
Chris Glaser
Hello I'm trying to upload some video files to the S3 Drive. However, every time I try I get an error message in gobbledygook that I don't understand. Anyone have any ideas about what's going wrong? Chris
Hi Chris, do you use external account (S3 / Rclone) or free 10GB that we provide?
Avatar
Chris Glaser 6/27/2024 8:03 AM
It's the free 10GB one
Avatar
Avatar
Chris Glaser
It's the free 10GB one
Thanks for letting me know, I've replied here: https://discord.com/channels/1069654792902815845/1255779287752249395 BTW. Just learned what the gobbledygook is 🙂 (edited)
sad mittens joined the server. 6/28/2024 1:41 AM
8:48 AM
This is a limit on S3 Drive's app side right?
8:49 AM
This is using the WebApp
Avatar
Avatar
CubityFirst
Click to see attachment 🖼️
This is S3Drive setting which ATM isn't configurable. I will put that higher on the list, so user can tweak it.
Avatar
❤️
9:04 AM
Thanks Tom
Kai joined the server. 6/28/2024 1:25 PM
Avatar
Avatar
Kai
Click to see original message
ablobwave 1
1:34 PM
Hi @Tom I just played around with S3Drive and my self-hosted minio server. Please find my observations: Testing this on a Linux system with the latest AppImage and the latest flatpak, both versions crash after a few seconds if you try to play a video inside the app. Encryption is turned on, for filenames, too. Using the same setup on Android with the latest version in the file explorer the mounts are still encrypted even if everything seems ok in the app.
Avatar
Avatar
Kai
Hi @Tom I just played around with S3Drive and my self-hosted minio server. Please find my observations: Testing this on a Linux system with the latest AppImage and the latest flatpak, both versions crash after a few seconds if you try to play a video inside the app. Encryption is turned on, for filenames, too. Using the same setup on Android with the latest version in the file explorer the mounts are still encrypted even if everything seems ok in the app.
Thanks, we're going to check both issues. On Android, can you try turn off / turn on mounts and see whether that helps?
Avatar
Avatar
Tom
Thanks, we're going to check both issues. On Android, can you try turn off / turn on mounts and see whether that helps?
I tried both and even stopped the app and started again, this does not seem to help. Another interesting fact. If you play and delete and add new buckets the other mounts are not getting cleared ending up with names for which no buckets exist anymore
Avatar
Avatar
Kai
Hi @Tom I just played around with S3Drive and my self-hosted minio server. Please find my observations: Testing this on a Linux system with the latest AppImage and the latest flatpak, both versions crash after a few seconds if you try to play a video inside the app. Encryption is turned on, for filenames, too. Using the same setup on Android with the latest version in the file explorer the mounts are still encrypted even if everything seems ok in the app.
On Linux we're waiting for Flutter team to release a fix: https://github.com/flutter/flutter/issues/150668 or if they won't include that fix soon, we'll need to downgrade our framework version: https://github.com/media-kit/media-kit/issues/852#issuecomment-2150949318
Avatar
Avatar
Kai
I tried both and even stopped the app and started again, this does not seem to help. Another interesting fact. If you play and delete and add new buckets the other mounts are not getting cleared ending up with names for which no buckets exist anymore
Right, it seems there is some mount refresh issue, we're going to check that out.
Avatar
Avatar
Tom
On Linux we're waiting for Flutter team to release a fix: https://github.com/flutter/flutter/issues/150668 or if they won't include that fix soon, we'll need to downgrade our framework version: https://github.com/media-kit/media-kit/issues/852#issuecomment-2150949318
Thanks, good to know
Avatar
Avatar
Kai
I tried both and even stopped the app and started again, this does not seem to help. Another interesting fact. If you play and delete and add new buckets the other mounts are not getting cleared ending up with names for which no buckets exist anymore
What's your phone model and Android version if I can ask?
MalionRay joined the server. 6/28/2024 4:36 PM
Avatar
Avatar
MalionRay
Click to see original message
4:39 PM
I am trying to view the picture as encryption in rclone, but it is not available. Is the function is available?
4:41 PM
Can I see the video streaming and listening the audio file in the encryption rclone in IPhone or iPad?
Avatar
Avatar
MalionRay
I am trying to view the picture as encryption in rclone, but it is not available. Is the function is available?
Hi @MalionRay! These two features are coming, the only way to stream encrypted media so far is to use disk mount, which is available on desktop on Android. Related: https://discord.com/channels/1069654792902815845/1069654792902815848/1255272081613127742 Features: Thumbnails for Rclone: https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends File preview for Rclone: https://s3drive.canny.io/feature-requests/p/implement-file-preview-for-rclone-back-ends iOS mount: https://s3drive.app/roadmap2024
yaoyao joined the server. 6/29/2024 4:02 PM
Tim Taylor joined the server. 7/1/2024 1:19 AM
Avatar
Avatar
Tom
Hi @MalionRay! These two features are coming, the only way to stream encrypted media so far is to use disk mount, which is available on desktop on Android. Related: https://discord.com/channels/1069654792902815845/1069654792902815848/1255272081613127742 Features: Thumbnails for Rclone: https://s3drive.canny.io/feature-requests/p/implement-thumbnails-for-rclone-back-ends File preview for Rclone: https://s3drive.canny.io/feature-requests/p/implement-file-preview-for-rclone-back-ends iOS mount: https://s3drive.app/roadmap2024
Thanks for your reply.
B433l joined the server. 7/1/2024 4:05 PM
Avatar
Hello @Tom, first of all thank you for creating such an amazing app. This is what I've been looking for ages since I can't run Termux and a-like apps on my device. I would like to report a crash issue I've noticed while using S3Drive on my P7P running GrapheneOS (Android 14) which I've been able to locate and send you the attached crash logs to further inspect the issue. Would that be ok? Where can I share those details? I would also like to know if the background sync should in fact work or not. On my device I'm able to confirm the APP was still running since I get those crashes but the sync will never happen except I open the app manually. Thanks for your hard work! (edited)
Avatar
Avatar
B433l
Hello @Tom, first of all thank you for creating such an amazing app. This is what I've been looking for ages since I can't run Termux and a-like apps on my device. I would like to report a crash issue I've noticed while using S3Drive on my P7P running GrapheneOS (Android 14) which I've been able to locate and send you the attached crash logs to further inspect the issue. Would that be ok? Where can I share those details? I would also like to know if the background sync should in fact work or not. On my device I'm able to confirm the APP was still running since I get those crashes but the sync will never happen except I open the app manually. Thanks for your hard work! (edited)
Hi there, thanks for you message. Please send it over to support in s3drive.app domain. It's indeed good to know that it somewhat works on GrapheneOS, as we haven't had a chance to try it out just yet. Background sync should work fine on Android, but as always the devil's is in the details, that is battery settings and how aggressively phone manufacturer interferes with the background framework... there is always a possibility that we've introduced some bug or there is some edge case that we haven't handled yet. We would be happy to try reproducing the "background" issue that you're experiencing and work on the solution. What's your back-end type, is that S3 or Rclone? Do you have E2E enabled? (edited)
Avatar
I'm currently using Rclone to sync over to Proton! I will open up an issue as soon as I have some free time. I'm right now trying with different exploit protection compatibility modes which are implemented by GrapheneOS itself to spot any differencies
4:50 PM
The crash itself seemed related to a service getting started when bluetooth is enabled (?) Unable to create service com.ryanheise.audioservice.AudioService: java.lang.ClassNotFoundException: Didn't find class "com.ryanheise.audioservice.AudioService"
Avatar
Avatar
B433l
The crash itself seemed related to a service getting started when bluetooth is enabled (?) Unable to create service com.ryanheise.audioservice.AudioService: java.lang.ClassNotFoundException: Didn't find class "com.ryanheise.audioservice.AudioService"
Oh dear, we've thought we've removed that completely, as it was causing different sorts of background issues (at the cost of audio background player support for Android, but that's lower priority then a robust app - https://pub.dev/packages/just_audio), yet it still haunts us. We've got one more report regarding Bluetooth causing issues, so it seems there was a regression in one of the past versions. We're going to redirect our efforts and hopefully develop a fix within next couple days. (edited)
🧠 1
Avatar
backblaze upload more than 100MB files still error anyway
Avatar
Avatar
mix9311
backblaze upload more than 100MB files still error anyway
In one of the next releases we will deploy improved multipart upload with per part auto-retry. Backblaze is facing consistent API failures, but eventually upload works fine. Their official stance (https://github.com/mastodon/mastodon/issues/30030#issuecomment-2123580531) is that software should issue infinite retries until it works and that's what we more or less plan doing which will improve situation. Backblaze:
We are currently engaged in improving performance across all data centers however this is a broad project and we do not specifically have a time frame available for when these service availability improvements may complete.
Also related: https://www.reddit.com/r/backblaze/comments/13eoicm/consistent_upload_failures/
I2rys (安全) joined the server. 7/2/2024 12:21 PM
Avatar
I2rys (安全) 7/2/2024 12:51 PM
@Tom Hello first off thank you very much for this very awesome program. Second I'm planning on buying S3Drive but may I ask how reliable S3Drive encryption is when it comes to corruption than Cryptomator (integrity)? Third, how many files can S3Drive handle? I'm pretty sure it depends on how much storage your cloud has but lets say a single folder contains about 300+ files, will it be able to handle such thing? (edited)
Avatar
Avatar
I2rys (安全)
@Tom Hello first off thank you very much for this very awesome program. Second I'm planning on buying S3Drive but may I ask how reliable S3Drive encryption is when it comes to corruption than Cryptomator (integrity)? Third, how many files can S3Drive handle? I'm pretty sure it depends on how much storage your cloud has but lets say a single folder contains about 300+ files, will it be able to handle such thing? (edited)
Hi, Both Cryptomator and S3Drive (which is directly compatible with Rclone - https://rclone.org/crypt/#chunk) are authenticated encryptions, so in the case there is any data corruption both encryption schemes can detect that. Each 64 KiB (that's quite small) of data is a separate block which is "authenticated" using 16 bytes, so if there is some corruption within that block you would still be able to decrypt it, however you wouldn't be able to confirm automatically if other data within that block is intact (you would need to verify yourself, e.g. play video). In the case of corruption within one block, other surrounding data 64 KiB data blocks would remain intact, decryptable and verifiable. Speaking of large files amount and huge folders, the answer is it depends. If you want to upload/download/browse it's usually fine. Challenging part on our end is copy/rename, as S3 protocol doesn't support bulk operations and rename natively. ... so if you have a folder with 300 files and you want to rename that folder, then S3Drive needs to issue 301 COPY operations and then 301 DELETE operations. That's 602 requests which depending on the network latency and the S3 API speed will take a while. We will be improving concurrency modes within app to improve the overall speed. We also plan to release managed storage plans S3 compatible, which will also support different protocols which will be more performant to run bulk operations or rename. Speaking of larger file amounts, it won't slow down the Files listings, as they're not recursive (they only fetch the amount of data to fit the screen), however functions like Storage stats, Recent, Trash, Cached mode index rebuild will gradually be slower with more files. It's hard to tell where's the tipping point, as we constantly release new improvements and ideas and have lots of features to improve overall perf: https://s3drive.canny.io/feature-requests/p/implement-searchorder-index-diff-rebuild I hope that helps a little! (edited)
catdance 1
Avatar
Avatar
Tom
Hi, Both Cryptomator and S3Drive (which is directly compatible with Rclone - https://rclone.org/crypt/#chunk) are authenticated encryptions, so in the case there is any data corruption both encryption schemes can detect that. Each 64 KiB (that's quite small) of data is a separate block which is "authenticated" using 16 bytes, so if there is some corruption within that block you would still be able to decrypt it, however you wouldn't be able to confirm automatically if other data within that block is intact (you would need to verify yourself, e.g. play video). In the case of corruption within one block, other surrounding data 64 KiB data blocks would remain intact, decryptable and verifiable. Speaking of large files amount and huge folders, the answer is it depends. If you want to upload/download/browse it's usually fine. Challenging part on our end is copy/rename, as S3 protocol doesn't support bulk operations and rename natively. ... so if you have a folder with 300 files and you want to rename that folder, then S3Drive needs to issue 301 COPY operations and then 301 DELETE operations. That's 602 requests which depending on the network latency and the S3 API speed will take a while. We will be improving concurrency modes within app to improve the overall speed. We also plan to release managed storage plans S3 compatible, which will also support different protocols which will be more performant to run bulk operations or rename. Speaking of larger file amounts, it won't slow down the Files listings, as they're not recursive (they only fetch the amount of data to fit the screen), however functions like Storage stats, Recent, Trash, Cached mode index rebuild will gradually be slower with more files. It's hard to tell where's the tipping point, as we constantly release new improvements and ideas and have lots of features to improve overall perf: https://s3drive.canny.io/feature-requests/p/implement-searchorder-index-diff-rebuild I hope that helps a little! (edited)
I2rys (安全) 7/2/2024 2:13 PM
Thankss tom for your reply! I'm wondering what do you mean by detect it? The reason I'm asking this is that I have been a long user of cryptomator and for some reason when renaming or moving large files sometimes corrupt them (unable to recover) and deleting them will just return an error. Also speaking of large files how does S3Drive handle when a network suddenly disconnects?
2:17 PM
2:19 PM
P.S After buying a subscription you will need to logout and login again for it to apply (Windows). Would be awesome if it automatically applies upon buying. ;) (edited)
Avatar
Avatar
I2rys (安全)
Thankss tom for your reply! I'm wondering what do you mean by detect it? The reason I'm asking this is that I have been a long user of cryptomator and for some reason when renaming or moving large files sometimes corrupt them (unable to recover) and deleting them will just return an error. Also speaking of large files how does S3Drive handle when a network suddenly disconnects?
Cryptomator cipher is somewhat more advanced which is the double-edged sword. I haven't exactly studied their model, but if you experience data loss during rename/move then it's likely related to additional protection of data movement mentioned here: https://docs.cryptomator.org/en/1.4/security/architecture/#filename-encryption I am not sure if failure that you experience is related to Cryptomator bug or design issue (E.g. expecting consistent storage, but cloud providers don't always guarantee consistency). Cryptomator needs to store additional file: masterkey.cryptomator located in the root directory of the vault. If for some reason this file isn't synced in your vault you won't be able to decrypt your files: https://docs.cryptomator.org/en/latest/security/architecture/#masterkey-file Directory contents move/rename protection isn't present for Rclone cipher, which I've mentioned here: https://github.com/rclone/rclone/issues/7192 (scroll down to: 4. No path protection), so there is no risk that data will be corrupted during move/rename. We receive bug reports frequently from our users, but there was no data corruption being mentioned (other than lost password), if that helps you to feel reassured. (edited)
Avatar
Avatar
I2rys (安全)
Thankss tom for your reply! I'm wondering what do you mean by detect it? The reason I'm asking this is that I have been a long user of cryptomator and for some reason when renaming or moving large files sometimes corrupt them (unable to recover) and deleting them will just return an error. Also speaking of large files how does S3Drive handle when a network suddenly disconnects?
I'm wondering what do you mean by detect it?
By saying detect, I mean that encryption scheme in both cases has built-in mechanism to verify data integrity, so it's not possible to flip bit of data in the middle of file (HDD corruption or deliberate attack by adversary) and expect that this will be undetected. In some use cases user must be ensured that content that they've encrypted actually belongs to them and wasn't altered. E.g. some legal text or some evidence etc.
2:40 PM
Also speaking of large files how does S3Drive handle when a network suddenly disconnects?
It depends if you refer to upload/download and whether you mention encrypted or unencrypted data. There are multiple safety mechanisms in place to prevent data corruption. For instance if file gets uploaded encrypted, S3Drive calculates the expected encrypted size (which differs from unencrypted size) and verifies with the S3 endpoint if it matches.
2:44 PM
P.S After buying a subscription you will need to logout and login again for it to apply (Windows). Would be awesome if it automatically applies upon buying. 😉
Thanks for the heads up and thank you for your purchase! ❤️ We haven't yet implemented reliable mechanism to auto-detect subscription purchase. As much as possible we try to keep app disconnected from any APIs which aren't required for day to day use, as more external requests means more questions and risks around data privacy.
(edited)
SA_rainbow_heart 1
PepeWideHeart 1
Avatar
Avatar
Tom
Cryptomator cipher is somewhat more advanced which is the double-edged sword. I haven't exactly studied their model, but if you experience data loss during rename/move then it's likely related to additional protection of data movement mentioned here: https://docs.cryptomator.org/en/1.4/security/architecture/#filename-encryption I am not sure if failure that you experience is related to Cryptomator bug or design issue (E.g. expecting consistent storage, but cloud providers don't always guarantee consistency). Cryptomator needs to store additional file: masterkey.cryptomator located in the root directory of the vault. If for some reason this file isn't synced in your vault you won't be able to decrypt your files: https://docs.cryptomator.org/en/latest/security/architecture/#masterkey-file Directory contents move/rename protection isn't present for Rclone cipher, which I've mentioned here: https://github.com/rclone/rclone/issues/7192 (scroll down to: 4. No path protection), so there is no risk that data will be corrupted during move/rename. We receive bug reports frequently from our users, but there was no data corruption being mentioned (other than lost password), if that helps you to feel reassured. (edited)
I2rys (安全) 7/2/2024 2:56 PM
Yeah and you're probably right about the failure but I'll just report it to them If I can find the exact issue. As for the rename that's a big ease for me because these data are precious Rainbow_skull and I'm also a bit paranoid. As for the detect I see thank you for the clarification, I'm not much in cryptography but I do have some knowledge about it. I was thinking It would automatically repair broken bytes whilst reading the file lol Last questions. Is there a way to donate to S3Drive with any amount? You see I'm a big fan of projects like these so I often donate to help the developers If I can. Also where can I suggest features or perhaps report bugs? Another P.S, uploaded files with dot can't be seen on transfers even though Hide Dotfiles is disabled. dog_laugh (edited)
Avatar
Avatar
I2rys (安全)
Yeah and you're probably right about the failure but I'll just report it to them If I can find the exact issue. As for the rename that's a big ease for me because these data are precious Rainbow_skull and I'm also a bit paranoid. As for the detect I see thank you for the clarification, I'm not much in cryptography but I do have some knowledge about it. I was thinking It would automatically repair broken bytes whilst reading the file lol Last questions. Is there a way to donate to S3Drive with any amount? You see I'm a big fan of projects like these so I often donate to help the developers If I can. Also where can I suggest features or perhaps report bugs? Another P.S, uploaded files with dot can't be seen on transfers even though Hide Dotfiles is disabled. dog_laugh (edited)
Yeah and you're probably right about the failure but I'll just report it to them If I can find the exact issue. As for the rename that's a big ease for me because these data are precious :Rainbow_skull: and I'm also a bit paranoid.
Honestly speaking, to be on the safe side regardless if it's Cryptomator, S3Drive or anything user should implement some backups. There are so many places where things can go wrong and even if it's not the S3Drive issue, the cloud provider might go bust or as simply DCs might caught fire (that was the cause with OVH recently).
As for the detect I see thank you for the clarification, I'm not much in cryptography but I do have some knowledge about it. I was thinking It would automatically repair broken bytes whilst reading the file lol
There isn't much redundancy built-in to the encryption scheme itself, however underlying storage has often the redundancy (E.g. Reed-Solomon) to recover lost bits/bytes which is usually enough for most cases.
Last questions. Is there a way to donate to S3Drive with any amount? You see I'm a big fan of projects like these so I often donate to help the developers If I can. Also where can I suggest features or perhaps report bugs?
It's really nice of you. We don't have any open donation channel, however we are funding development by selling subscriptions and licenses, if you would like to help out, feel free to spread the love, recommend our app or leave us a comment. This in turn brings us more users which may or may not decide to buy paid version.
Also where can I suggest features or perhaps report bugs?
Ideally please add them here: #support or if there is anything requiring more confidentiality, please send to support at s3drive.app or DM myself.
Another P.S, uploaded files with dot can't be seen on transfers even though Hide Dotfiles is disabled.
What's your OS and what functions have you used? Was it Upload files or Upload folder etc?.
(edited)
blob_dancing 1
Avatar
Avatar
Tom
Yeah and you're probably right about the failure but I'll just report it to them If I can find the exact issue. As for the rename that's a big ease for me because these data are precious :Rainbow_skull: and I'm also a bit paranoid.
Honestly speaking, to be on the safe side regardless if it's Cryptomator, S3Drive or anything user should implement some backups. There are so many places where things can go wrong and even if it's not the S3Drive issue, the cloud provider might go bust or as simply DCs might caught fire (that was the cause with OVH recently).
As for the detect I see thank you for the clarification, I'm not much in cryptography but I do have some knowledge about it. I was thinking It would automatically repair broken bytes whilst reading the file lol
There isn't much redundancy built-in to the encryption scheme itself, however underlying storage has often the redundancy (E.g. Reed-Solomon) to recover lost bits/bytes which is usually enough for most cases.
Last questions. Is there a way to donate to S3Drive with any amount? You see I'm a big fan of projects like these so I often donate to help the developers If I can. Also where can I suggest features or perhaps report bugs?
It's really nice of you. We don't have any open donation channel, however we are funding development by selling subscriptions and licenses, if you would like to help out, feel free to spread the love, recommend our app or leave us a comment. This in turn brings us more users which may or may not decide to buy paid version.
Also where can I suggest features or perhaps report bugs?
Ideally please add them here: #support or if there is anything requiring more confidentiality, please send to support at s3drive.app or DM myself.
Another P.S, uploaded files with dot can't be seen on transfers even though Hide Dotfiles is disabled.
What's your OS and what functions have you used? Was it Upload files or Upload folder etc?.
(edited)
I2rys (安全) 7/2/2024 9:48 PM
I understand and yeah you're right no matter the software that you use to upload encrypted files you must always have a backup, as for my case good thing I keep about 3 backups of the original data regularly Haahah, also thankss. Btw It's Windows 10 and I used upload folder. May I ask some questions again? XD
  • Why does a folder disappears after deleting the .empty file, is it automatically deleted by S3Drive?
  • Is it just me or Cyberduck seems faster than S3Drive? It seems to have something with how they upload. I get about 9-10/Mbps in Cyberduck while I only get around 3-5/Mbps in S3Drive
Avatar
Avatar
I2rys (安全)
I understand and yeah you're right no matter the software that you use to upload encrypted files you must always have a backup, as for my case good thing I keep about 3 backups of the original data regularly Haahah, also thankss. Btw It's Windows 10 and I used upload folder. May I ask some questions again? XD
  • Why does a folder disappears after deleting the .empty file, is it automatically deleted by S3Drive?
  • Is it just me or Cyberduck seems faster than S3Drive? It seems to have something with how they upload. I get about 9-10/Mbps in Cyberduck while I only get around 3-5/Mbps in S3Drive
Why does a folder disappears after deleting the .empty file, is it automatically deleted by S3Drive?
There isn't really concept of folders within S3 protocol. Folders are emulated and are direct consequence of Common Prefix for file or multiple files within "/" delimited path. We use .empty file as a single file from which its parent folder prefix is born. Alternatively we could try to insert: folder/ key as a folder placeholder, but that's not universally support across providers and isn't cross-compatible approach. E.g. MinIO (most common self-hosted file-based S3 server doesn't support it).
Is it just me or Cyberduck seems faster than S3Drive? It seems to have something with how they upload. I get about 9-10/Mbps in Cyberduck while I only get around 3-5/Mbps in S3Drive
What's your platform, is that macOS? I assume that E2E encryption is enabled? Do you use Multipart upload? Do you refer to upload speed through the app or mount write speed? Is it combined speed of multiple files upload or single big file upload? In 1.9.3 that we're just releasing (on macOS it shall be available within ~2 days) there is improved concurrency for multipart uploads: https://s3drive.app/changelog which might make multipart uploads faster than if it was disabled (it was the other round previously). The speed bottleneck for single big file might still be single-threaded encryption XSalsa20-Poly1305 (which is lighter than AES-GCM used by Cryptomator, but doesn't have benefits of hardware encryption which AES has). For multiple files upload encryption speed this shouldn't be an issue, as encryption load would be spread evenly on multiple CPU threads/cores. In the next releases we will be improving single big file encryption speeds, by providing multi-threaded chunk encryption. We're actively improving in all these areas.
(edited)
Avatar
Avatar
Tom
Why does a folder disappears after deleting the .empty file, is it automatically deleted by S3Drive?
There isn't really concept of folders within S3 protocol. Folders are emulated and are direct consequence of Common Prefix for file or multiple files within "/" delimited path. We use .empty file as a single file from which its parent folder prefix is born. Alternatively we could try to insert: folder/ key as a folder placeholder, but that's not universally support across providers and isn't cross-compatible approach. E.g. MinIO (most common self-hosted file-based S3 server doesn't support it).
Is it just me or Cyberduck seems faster than S3Drive? It seems to have something with how they upload. I get about 9-10/Mbps in Cyberduck while I only get around 3-5/Mbps in S3Drive
What's your platform, is that macOS? I assume that E2E encryption is enabled? Do you use Multipart upload? Do you refer to upload speed through the app or mount write speed? Is it combined speed of multiple files upload or single big file upload? In 1.9.3 that we're just releasing (on macOS it shall be available within ~2 days) there is improved concurrency for multipart uploads: https://s3drive.app/changelog which might make multipart uploads faster than if it was disabled (it was the other round previously). The speed bottleneck for single big file might still be single-threaded encryption XSalsa20-Poly1305 (which is lighter than AES-GCM used by Cryptomator, but doesn't have benefits of hardware encryption which AES has). For multiple files upload encryption speed this shouldn't be an issue, as encryption load would be spread evenly on multiple CPU threads/cores. In the next releases we will be improving single big file encryption speeds, by providing multi-threaded chunk encryption. We're actively improving in all these areas.
(edited)
I2rys (安全) 7/2/2024 11:27 PM
I'm kind off new to S3 and I did some experiment and yeah It does disappear if a folder doesn't have any files on it and .empty is used to make sure the folder can be identified If I'm not mistaken. And no, I'm using Windows and yes E2E encryption is enabled, as for multipart upload I decided to disabled it because It's much slower and I used the app because WebDav is slower. skull_black I see that make sense, well I'm excited for the new update!
Avatar
Avatar
I2rys (安全)
I'm kind off new to S3 and I did some experiment and yeah It does disappear if a folder doesn't have any files on it and .empty is used to make sure the folder can be identified If I'm not mistaken. And no, I'm using Windows and yes E2E encryption is enabled, as for multipart upload I decided to disabled it because It's much slower and I used the app because WebDav is slower. skull_black I see that make sense, well I'm excited for the new update!
This is to let you know that 1.9.3 is released on Windows, feel free to try out multipart mode. In next releases we will be tweaking concurrency settings, further improving multipart mode and expose settings to the user, so they can tweak it according to their desired use. If you face any issues with the app or would like to submit a new request, please visit: #support Thanks ! (edited)
chikadance 1
EXZ_FireSkyBlue 1
❤️ 1
johan joined the server. 7/4/2024 1:55 AM
Avatar
Avatar
johan
Click to see original message
I2rys (安全) 7/5/2024 3:17 AM
Welcome.
Slotherman joined the server. 7/6/2024 7:42 AM
Avatar
Question, under the Sync configuration menu I have the From end To "Local" button greyed out, meaning I cannot sync from/to local and only Remote/Remote is available. How/where do I configure a "Local" entry so that I can sync to a remote bucket? I'm on iOS, 🐸
Avatar
Avatar
Slotherman
Question, under the Sync configuration menu I have the From end To "Local" button greyed out, meaning I cannot sync from/to local and only Remote/Remote is available. How/where do I configure a "Local" entry so that I can sync to a remote bucket? I'm on iOS, 🐸
Local sync is available on all platforms but iOS, this is because iOS doesn't expose local file system which is required for current sync implementation. We're exploring workarounds, but most likely in the nearest future Local option will point to some in-app storage which could be shared with other apps, but as such making current Sync to access e.g. Download or Documents folder directly won't be possible soon.
Avatar
Is the problem with folders specifically? I know Strongbox (keepass) can refer to files in the local filesystem in other app directories (in my case the syncthing folder)
6:15 PM
A KeePass/Password Safe Client for iOS and OS X. Contribute to strongbox-password-safe/Strongbox development by creating an account on GitHub.
Avatar
Maybe it’s nice to have a text saying something like this in the sync interface or in the documentation, I tried looking it up but couldn’t find it
Avatar
Avatar
Slotherman
Is the problem with folders specifically? I know Strongbox (keepass) can refer to files in the local filesystem in other app directories (in my case the syncthing folder)
Cool, thanks for this resource. We'll definitely have a look and see what we can feasibly implement. We'll certainly allow way of accessing data from/to other apps in the future. Whether this cross-app access can be used to integrate with our current Sync (which is more of a desktop class sync, which was reworked to run on mobile), it's hard to tell, we may have to build some specific simplified Sync just for iOS.
Avatar
Avatar
Slotherman
Maybe it’s nice to have a text saying something like this in the sync interface or in the documentation, I tried looking it up but couldn’t find it
Sure, yes, it's bit confusing at the moment. We'll improve on that. The reason we haven't done already it likely because we'd hoped we can actually get this to work sooner. (edited)
neoOpus joined the server. 7/9/2024 6:55 AM
Avatar
Unlawful Cactus 7/10/2024 9:41 AM
Are you guys aware the storage information has started showing null values on Android recently? I noticed it yesterday in version 1.9.4, and it's still there in 1.9.5. On the S3 backend it's corrected after refreshing it, on the rclone WebDAV backend it isn't. Also what it says there makes no sense: 690.70 MB used, files: nullof 10 GB (edited)
9:43 AM
The null values on the S3 backend happen/return when switching from the rclone backend to S3.
Avatar
Avatar
Unlawful Cactus
Are you guys aware the storage information has started showing null values on Android recently? I noticed it yesterday in version 1.9.4, and it's still there in 1.9.5. On the S3 backend it's corrected after refreshing it, on the rclone WebDAV backend it isn't. Also what it says there makes no sense: 690.70 MB used, files: nullof 10 GB (edited)
Oh dear, thanks for finding that out. We're going to have it addressed in a next release. Sorry for this gibberish especially on Rclone back-ends.
Avatar
Avatar
Unlawful Cactus
Are you guys aware the storage information has started showing null values on Android recently? I noticed it yesterday in version 1.9.4, and it's still there in 1.9.5. On the S3 backend it's corrected after refreshing it, on the rclone WebDAV backend it isn't. Also what it says there makes no sense: 690.70 MB used, files: nullof 10 GB (edited)
Since we've added new files counter, they will show up as null for any preexisting stats until refreshed with new S3Drive version... however it seems there is a persistence issue (with files counter) when e.g. user switch other S3/Rclone account and returns. This will be fixed in a next release. Thanks for finding that out. (edited)
YFL joined the server. 7/11/2024 8:05 AM
Juscelino Comitcheka joined the server. 7/11/2024 4:12 PM
un1c0rn joined the server. 7/14/2024 7:21 AM
Dongchen joined the server. 7/14/2024 9:57 AM
Avatar
Hi. Where is the decryption key persistently stored in device storage? Edit: I just head about "rclone obscure". So it's not safe to assume security of keys on the machine running S3Drive, then (edited)
Avatar
Avatar
Dongchen
Click to see original message
I2rys (安全) 7/14/2024 9:59 AM
Welcome
👋 1
Avatar
Avatar
Dongchen
Hi. Where is the decryption key persistently stored in device storage? Edit: I just head about "rclone obscure". So it's not safe to assume security of keys on the machine running S3Drive, then (edited)
I2rys (安全) 7/14/2024 10:01 AM
@Tom superYay
Avatar
Avatar
Dongchen
Hi. Where is the decryption key persistently stored in device storage? Edit: I just head about "rclone obscure". So it's not safe to assume security of keys on the machine running S3Drive, then (edited)
rclone obscure is meant to prevent "eyedropping" only. Imagine someone watches you behind your back.
Avatar
Avatar
Dongchen
Hi. Where is the decryption key persistently stored in device storage? Edit: I just head about "rclone obscure". So it's not safe to assume security of keys on the machine running S3Drive, then (edited)
Your back-end credentials and encryption key are stored in trusted platform depending on the OS. E.g. Keychain on iOS, KeyStore on Android or libsecret for linux. What's your OS? (edited)
Avatar
Thanks. So S3Drive does not use rclone config files for storing the key? Ubuntu 24.04
smantzavinos joined the server. 7/15/2024 12:19 AM
Satoshi joined the server. 7/15/2024 4:45 AM
Avatar
Avatar
Dongchen
Thanks. So S3Drive does not use rclone config files for storing the key? Ubuntu 24.04
If you setup S3 back-end from the S3 tab, then S3Drive doesn't use Rclone unless you use mount or sync. If you setup back-end from the Rclone tab or use mount/sync for any back-end, then S3Drive uses Rclone config stored in the config file in the rclone config file path, which likely resolves to: /home/<user>/.config/rclone/rclone.conf on Ubuntu. We will be implementing config encryption in order to secure the Rclone config: https://rclone.org/docs/#configuration-encryption EDIT: Added feature request: https://s3drive.canny.io/feature-requests/p/rclone-encrypted-config (edited)
Lord Wellen Dowd joined the server. 7/15/2024 10:00 AM
Brunvik joined the server. 7/15/2024 3:10 PM
Mitch Crimi (PrefersAwkward) joined the server. 7/15/2024 5:50 PM
SoulKeeper joined the server. 7/16/2024 12:16 AM
Avatar
@Tom I am sorry for bothering you. I just bought the monthly ultimate plan probably an hour ago to pair it with IDrive e2 on my Android phone. But after trying it out and comparing it with Round Sync, I do not think I need S3Drive app right now. I will probably come back later, but for now I would like to stick to Round Sync app as it is free and meets my need. I would really appreciate if you could kindly cancel my subscription and process a refund? But if you can not process a refund, I will respect your decision. Thank you!
12:24 AM
Sorry for messing here. I could not find your support email on the website
Avatar
Avatar
SoulKeeper
@Tom I am sorry for bothering you. I just bought the monthly ultimate plan probably an hour ago to pair it with IDrive e2 on my Android phone. But after trying it out and comparing it with Round Sync, I do not think I need S3Drive app right now. I will probably come back later, but for now I would like to stick to Round Sync app as it is free and meets my need. I would really appreciate if you could kindly cancel my subscription and process a refund? But if you can not process a refund, I will respect your decision. Thank you!
Hi, no worries, if you've ordered through Google Play you shall be able to easily cancel your fresh purchase: https://support.google.com/googleplay/workflow/9813244?hl=en If you've ordered through our website please send us a quick e-mail to support within s3drive.app domain. (edited)
Request a Google Play purchase refund with our easy, self-help flow that lets you skip the line and submit refund requests on Play purchases.
Avatar
Avatar
Tom
Hi, no worries, if you've ordered through Google Play you shall be able to easily cancel your fresh purchase: https://support.google.com/googleplay/workflow/9813244?hl=en If you've ordered through our website please send us a quick e-mail to support within s3drive.app domain. (edited)
Thank you Sir. I have sent an email to your support email along with a screenshot of the above message so whoever in your team reads my email will understand that I spoke with you.
Avatar
Avatar
SoulKeeper
Thank you Sir. I have sent an email to your support email along with a screenshot of the above message so whoever in your team reads my email will understand that I spoke with you.
No worries, we've refunded your order, you should've received confirmation on your e-mail. It usually takes couple days for funds to be processed back to your account.
Avatar
Avatar
SoulKeeper
Thank you Sir. I have sent an email to your support email along with a screenshot of the above message so whoever in your team reads my email will understand that I spoke with you.
Speaking of Windows issues that you've experienced on 1.9.6, you can always find previous versions on our Github page: https://github.com/s3drive/windows-app/releases By any chance, does issue exist on 1.9.4 as well?
Avatar
Avatar
Tom
No worries, we've refunded your order, you should've received confirmation on your e-mail. It usually takes couple days for funds to be processed back to your account.
Thank you! I will keep a close eye on your development and will subscribe once you start offering storage (apart from the 10GB free).
Avatar
Avatar
Tom
Speaking of Windows issues that you've experienced on 1.9.6, you can always find previous versions on our Github page: https://github.com/s3drive/windows-app/releases By any chance, does issue exist on 1.9.4 as well?
The issue I have been experiencing with your app is kinda strange (I have never come across this issue with any other app). So, this is my office laptop with a password protected admin access (I know the admin credential by the way). Usually, some apps ask me for for admin ID and password while installing and some apps do not ask them. But regardless of the admin permission at the the beginning, all the apps work flawlessly afterwards without asking for admin access again. However, your app does not ask me for any admin access while installing. When I open the app, it gives me a login page. I enter the login credential and it gets stuck at "Logging in" and after 10-15 seconds, the app force closes. Afterwards, whenever I try to open the app, it force closes with a black screen. Here comes the interesting part. If I right click on the app and "run as administrator" and enter the admin credential, it starts working normally. I have no idea why the app is acting this way.
8:16 AM
I don't know if it makes sense to you at all. I tried uninstalling and reinstalling the app multiple times but it's behaving the same way. WIthout running the app as administrator, it force closes.
Avatar
Avatar
SoulKeeper
The issue I have been experiencing with your app is kinda strange (I have never come across this issue with any other app). So, this is my office laptop with a password protected admin access (I know the admin credential by the way). Usually, some apps ask me for for admin ID and password while installing and some apps do not ask them. But regardless of the admin permission at the the beginning, all the apps work flawlessly afterwards without asking for admin access again. However, your app does not ask me for any admin access while installing. When I open the app, it gives me a login page. I enter the login credential and it gets stuck at "Logging in" and after 10-15 seconds, the app force closes. Afterwards, whenever I try to open the app, it force closes with a black screen. Here comes the interesting part. If I right click on the app and "run as administrator" and enter the admin credential, it starts working normally. I have no idea why the app is acting this way.
Thanks for that, that's really helpful. I will pass that to our team, so they can investigate that. Is that Windows 10 or 11?
Avatar
Avatar
Tom
Thanks for that, that's really helpful. I will pass that to our team, so they can investigate that. Is that Windows 10 or 11?
Windows 11 Pro
👌 1
Avatar
Avatar
Tom
If you setup S3 back-end from the S3 tab, then S3Drive doesn't use Rclone unless you use mount or sync. If you setup back-end from the Rclone tab or use mount/sync for any back-end, then S3Drive uses Rclone config stored in the config file in the rclone config file path, which likely resolves to: /home/<user>/.config/rclone/rclone.conf on Ubuntu. We will be implementing config encryption in order to secure the Rclone config: https://rclone.org/docs/#configuration-encryption EDIT: Added feature request: https://s3drive.canny.io/feature-requests/p/rclone-encrypted-config (edited)
Unlawful Cactus 7/16/2024 12:16 PM
I assume on Android it's stored in S3Drive's private app data directory?
Avatar
Avatar
SoulKeeper
@Tom I am sorry for bothering you. I just bought the monthly ultimate plan probably an hour ago to pair it with IDrive e2 on my Android phone. But after trying it out and comparing it with Round Sync, I do not think I need S3Drive app right now. I will probably come back later, but for now I would like to stick to Round Sync app as it is free and meets my need. I would really appreciate if you could kindly cancel my subscription and process a refund? But if you can not process a refund, I will respect your decision. Thank you!
Unlawful Cactus 7/16/2024 12:20 PM
Keep in mind that Round Sync has lots of bugs and isn't actively developed. When I tested it I ran into so many bugs I lost all trust in it. Of course your mileage may vary, it may depend on use-case.
Avatar
Avatar
Unlawful Cactus
I assume on Android it's stored in S3Drive's private app data directory?
Pretty much, yes: https://developer.android.com/training/data-storage/app-specific#internal-access-files
Other apps cannot access files stored within internal storage. This makes internal storage a good place for app data that other apps shouldn't access.
👍 1
Avatar
Riccardo Bellanova 7/16/2024 3:58 PM
Hello @Tom, is possible in your opinion have a loading status (%) for download/upload operations with the mounted drive? (edited)
Avatar
Avatar
Riccardo Bellanova
Hello @Tom, is possible in your opinion have a loading status (%) for download/upload operations with the mounted drive? (edited)
Hi, such loading status should already be provided by your operating OS. Depending on the VFS cache settings it may be true or not. If you disable VFS cache completely from the app, then loading indicator provided by the OS shall be blocking until files are copied. Does it work for you or perhaps I've misunderstood your question? Of course we could provide additional status indicators within the app. E.g. if there is some pending operation, then tray icon could show some additional icon and possibly, tray menu could show some text e.g.: 45MB out of 120MB etc.
Avatar
Avatar
Tom
Hi, such loading status should already be provided by your operating OS. Depending on the VFS cache settings it may be true or not. If you disable VFS cache completely from the app, then loading indicator provided by the OS shall be blocking until files are copied. Does it work for you or perhaps I've misunderstood your question? Of course we could provide additional status indicators within the app. E.g. if there is some pending operation, then tray icon could show some additional icon and possibly, tray menu could show some text e.g.: 45MB out of 120MB etc.
Riccardo Bellanova 7/16/2024 4:06 PM
I've cache mode set to Full, but with Nemo file explorer I can't see anything about loading
4:07 PM
btw could be cute add even the mount drive operations on transfers sections
Avatar
Avatar
Riccardo Bellanova
I've cache mode set to Full, but with Nemo file explorer I can't see anything about loading
With settings set to Full the copy will be very fast, because it will be within your HDD/SSD. If file isn't big the loading indicator may not even appear. Can you try disabling VFS cache (use off) and stop/start mount? Regardless, as you say, loading indicator would probably be helpful as well. We will add it to internal list, however can't promise ETA at this stage.
Avatar
Riccardo Bellanova 7/16/2024 4:09 PM
okok thank you
Ludwig joined the server. 7/16/2024 7:09 PM
M2B joined the server. 7/17/2024 3:05 PM
M2B joined the server. 7/17/2024 3:05 PM
MidnightSoup joined the server. 7/18/2024 6:55 PM
Midnight-Soup joined the server. 7/18/2024 6:55 PM
Avatar
Midnight-Soup 7/18/2024 7:01 PM
Hey, nice app! I have a multi-part question which i think part of it is addressed in the docs, but I'd just like to verify before purchase please. From the docs I understand I can Sync foo.txt from a device to 1 or many S3 providers at once which is great. Say I have syced a bunch of files already to a single S3 bucket only, is there the concept of syncing that bucket to 1 or many other buckets to bring them into unison? Also, this is more of a nice to have - can I configure sync rules for different directories to sync to different buckets? Many thanks
Avatar
Avatar
Midnight-Soup
Hey, nice app! I have a multi-part question which i think part of it is addressed in the docs, but I'd just like to verify before purchase please. From the docs I understand I can Sync foo.txt from a device to 1 or many S3 providers at once which is great. Say I have syced a bunch of files already to a single S3 bucket only, is there the concept of syncing that bucket to 1 or many other buckets to bring them into unison? Also, this is more of a nice to have - can I configure sync rules for different directories to sync to different buckets? Many thanks
I2rys (安全) 7/18/2024 9:46 PM
Hi! A customer here. Yes, you can sync a single bucket to other multiple buckets with S3Drive. You can also configure which directory you want the data to be synced to. Current modes are: Copy, Sync, Move, Two-way (edited)
Avatar
Avatar
I2rys (安全)
Hi! A customer here. Yes, you can sync a single bucket to other multiple buckets with S3Drive. You can also configure which directory you want the data to be synced to. Current modes are: Copy, Sync, Move, Two-way (edited)
Midnight-Soup 7/18/2024 10:02 PM
Spot on thanks a lot! I'll get my order in.
Mustarehi joined the server. 7/19/2024 12:15 AM
Avatar
Avatar
Mustarehi
Click to see original message
Avatar
Avatar
Midnight-Soup
Spot on thanks a lot! I'll get my order in.
I2rys (安全) 7/19/2024 1:41 AM
Anytime!
Avatar
Mount
Avatar
Avatar
MalionRay
Mount
I2rys (安全) 7/19/2024 9:00 AM
ain
Avatar
Midnight-Soup 7/19/2024 4:04 PM
This is exactly what I've been looking for, I can bin off my shonky colletion of cronjobs. Hopefully last question - I learned the hard way if you swap profile mid transfer, the transfer fails - I am guessing no mitigation for that?
Avatar
Avatar
Midnight-Soup
This is exactly what I've been looking for, I can bin off my shonky colletion of cronjobs. Hopefully last question - I learned the hard way if you swap profile mid transfer, the transfer fails - I am guessing no mitigation for that?
Hi! Founder here. Even though multiple accounts is most commonly used app feature, initially S3Drive supported only single S3 credentials. This makes some app functionality constrained to currently selected profile, as the UI and/or internal weren't built with multiple accounts in mind. Major exception to this rule is Sync feature which was built early this year and can already support multiple accounts at the time. We will improve in that area, we track this under this feature request: https://s3drive.canny.io/feature-requests/p/support-simultaneous-accounts-operation (edited)
Avatar
Avatar
Tom
Hi! Founder here. Even though multiple accounts is most commonly used app feature, initially S3Drive supported only single S3 credentials. This makes some app functionality constrained to currently selected profile, as the UI and/or internal weren't built with multiple accounts in mind. Major exception to this rule is Sync feature which was built early this year and can already support multiple accounts at the time. We will improve in that area, we track this under this feature request: https://s3drive.canny.io/feature-requests/p/support-simultaneous-accounts-operation (edited)
Midnight-Soup 7/20/2024 11:08 AM
Great, thank you!
Avatar
Hi, I recently updated S3 drive and now it's asking for my email address and password. Is this now required?
Avatar
Avatar
myfrogger
Hi, I recently updated S3 drive and now it's asking for my email address and password. Is this now required?
I2rys (安全) 7/23/2024 3:01 AM
Hello, as far as I know It's always required so S3Drive can check if you have the subscription or not. (edited)
Avatar
It wasn't in the past. It's my fault for not being active in this community when that tracking stuff was implemented. I am willing to buy a license but taking an email address now our files are associated to some personally identifiable information. (edited)
Avatar
Avatar
myfrogger
It wasn't in the past. It's my fault for not being active in this community when that tracking stuff was implemented. I am willing to buy a license but taking an email address now our files are associated to some personally identifiable information. (edited)
I2rys (安全) 7/23/2024 3:17 AM
That's only if you use S3Drive own storage but external storages from other providers nope thus if you're using other provider but S3Drive as client, it won't associate it with your account. (edited)
name joined the server. 7/23/2024 7:59 AM
Avatar
Avatar
myfrogger
Hi, I recently updated S3 drive and now it's asking for my email address and password. Is this now required?
Hi, welcome back! It's only required if you would like to use free managed 10GB account or would like to purchase all platforms license through our website. In-app purchases (iOS/Android) do not require e-mail/password account, as this is managed through platform respective billing API. Quick info about licenses: https://s3drive.app/faq?q=website_vs_inapp Obviously user can use S3Drive without license or e-mail and use only their S3 credentials.
It wasn't in the past.
The only change around setup that we've introduced recently was to switch default screen to standard login/password instead, however you can switch to previous/old S3 screen, by clicking: Connect link.
I am willing to buy a license but taking an email address now our files are associated to some personally identifiable information.
I take the point, but one could argue about it. If S3Drive team have access to your files, then personally identifiable information could likely (depending on the files sensitivity) be derived from the file contents/names, regardless of payment method. Conversely, if S3Drive team doesn't have access to your files, then there isn't really direct association between files and credit card personally identifiable information. Most importantly license is suitable for users who would like to use external S3/Rclone back-end, that implies: a) file contents and metadata aren't stored on S3Drive servers (data isn't in our hands), b) if E2E encryption is enabled (it's Rclone compatible BTW), then neither the storage operator nor S3Drive can see the file contents or file names. Password is managed solely by the user and files are decrypted/encrypted only within the client. As always, we're open for improvements. What would be your preferred payment method? One way to solve this is to offer payments via crypto, which we plan to implement at some point. Regardless how you decide to buy a license, we would be willing to give you -30% Early Adopters coupon code.
(edited)
hragon joined the server. 7/23/2024 11:56 AM
Avatar
Avatar
hragon
Click to see original message
dsus joined the server. 7/24/2024 5:23 AM
Arslan joined the server. 7/24/2024 9:29 PM
Avatar
Avatar
hragon
Click to see original message
I2rys (安全) 7/25/2024 12:01 AM
Welcome
Avatar
InfiniteAds559 7/25/2024 1:02 AM
Hi, trying out the link sharing feature and I'm getting this error
Avatar
Avatar
InfiniteAds559
Hi, trying out the link sharing feature and I'm getting this error
Hi, please report the bug in #support so Tom can ask follow-up questions if needed and let you know once he has more information
🔥 1
Avatar
Avatar
InfiniteAds559
Hi, trying out the link sharing feature and I'm getting this error
I2rys (安全) 7/25/2024 1:38 AM
Does it happen to other files too? (edited)
Avatar
InfiniteAds559 7/25/2024 2:45 AM
Only tried with photos and videos
🔥 1
danonyez joined the server. 7/25/2024 2:58 AM
Chris joined the server. 7/25/2024 12:50 PM
dr-who joined the server. 7/27/2024 6:28 PM
Goose joined the server. 7/28/2024 8:26 AM
Avatar
Avatar
Goose
Click to see original message
Avatar
Avatar
Goose
Click to see original message
I2rys (安全) 7/28/2024 8:39 AM
Welcome
peanutbutterfly joined the server. 7/28/2024 7:09 PM
Avatar
peanutbutterfly 7/28/2024 11:03 PM
Hi I have been looking for a a cloud storage solution that lets me have files for example videos to be uploaded with encryption but that I can preview them either on android or pc without having to download them and I discovered this app which looks like a good solution for that? I started setting up koofr vault and rclone but it says that video preview cant be done with rclone yet so I tested with backblaze and it looks like it could work but when I tried it says I need a ultimate subscription... so am I correct in assuming that it would work in backblaze as long as I have the subscription? So then I could upload encrypted files to backblaze and when I needed to preview them I would do so via the s3drive app without downloading them? Can anyone confirm if thats how it works? I would buy the lifetime if so, ty ^^
Avatar
Avatar
peanutbutterfly
Hi I have been looking for a a cloud storage solution that lets me have files for example videos to be uploaded with encryption but that I can preview them either on android or pc without having to download them and I discovered this app which looks like a good solution for that? I started setting up koofr vault and rclone but it says that video preview cant be done with rclone yet so I tested with backblaze and it looks like it could work but when I tried it says I need a ultimate subscription... so am I correct in assuming that it would work in backblaze as long as I have the subscription? So then I could upload encrypted files to backblaze and when I needed to preview them I would do so via the s3drive app without downloading them? Can anyone confirm if thats how it works? I would buy the lifetime if so, ty ^^
I2rys (安全) 7/28/2024 11:35 PM
Hi customer here. Yes you're right, you can also preview other files not just pictures and videos like documents, TXT files and so forth.
nightfire445 joined the server. 7/29/2024 2:59 AM
Avatar
Avatar
peanutbutterfly
Hi I have been looking for a a cloud storage solution that lets me have files for example videos to be uploaded with encryption but that I can preview them either on android or pc without having to download them and I discovered this app which looks like a good solution for that? I started setting up koofr vault and rclone but it says that video preview cant be done with rclone yet so I tested with backblaze and it looks like it could work but when I tried it says I need a ultimate subscription... so am I correct in assuming that it would work in backblaze as long as I have the subscription? So then I could upload encrypted files to backblaze and when I needed to preview them I would do so via the s3drive app without downloading them? Can anyone confirm if thats how it works? I would buy the lifetime if so, ty ^^
Hi! Video preview of encrypted videos works for S3 endpoints, not for Rclone (this is coming), so if you set up Backblaze using S3 setup screen: https://docs.s3drive.app/setup/bucket/ instead of Rclone it shall work just fine. Koofr vaults are entirely compatible with both S3 and https://rclone.org/crypt/ that we support, so instead of Rclone config, one could set it up with S3Drive, the issue is that we haven't yet implemented support for custom Rclone salt and 2ndary password which Koofr seem to be using in their vault, feature requests: https://s3drive.canny.io/feature-requests/p/add-support-for-custom-rclone-salt and https://s3drive.canny.io/feature-requests/p/support-2nd-rclone-crypt-password Whatever gets implemented first, Rclone streaming: https://s3drive.canny.io/feature-requests/p/implement-video-streaming-for-rclone-back-ends or support for additional cipher params, it will allow you to play-out Koofr Vault videos as well. I hope that helps, if you would like to give it a go as it is, I would be happy to enable trial on your account, in such case, please register: https://s3drive.app/signin and then click on Join: https://s3drive.app/pricing (but don't pay, this is so your account gets transferred to the billing system) and either DM me your e-mail or send it over to support in s3drive.app domain. (edited)
loudfm joined the server. 7/29/2024 5:45 PM
Ale joined the server. 7/29/2024 8:43 PM
delimiters#1001 joined the server. 7/30/2024 5:30 AM
Backsight joined the server. 7/30/2024 3:52 PM
Avatar
Hey so I have an s23 ultra, I'm using the default Samsung gallery app and I can see the albums I create in S3drive just fine, But I'd like to start using Google photos as my main gallery app but the albums I create in Google photos are nowhere to be found in S3drive app... Is there any trick to have my google photos albums show up in s3drive just like they do in Samsung gallery?
Avatar
Avatar
Backsight
Hey so I have an s23 ultra, I'm using the default Samsung gallery app and I can see the albums I create in S3drive just fine, But I'd like to start using Google photos as my main gallery app but the albums I create in Google photos are nowhere to be found in S3drive app... Is there any trick to have my google photos albums show up in s3drive just like they do in Samsung gallery?
Hi, Is it possible that albums that you create using Google Photos aren't stored locally or are sandboxed within the Google Photos app scope? Is there any possibility to configure Google Photos, so it keeps albums in DCIM, Camera or other folder? We haven't played with Google Photos just yet, but we will get to that, as we would certainly like to provide easy backup/migration path from external apps.
2weekZ joined the server. 7/30/2024 6:43 PM
Avatar
Avatar
Tom
Hi, Is it possible that albums that you create using Google Photos aren't stored locally or are sandboxed within the Google Photos app scope? Is there any possibility to configure Google Photos, so it keeps albums in DCIM, Camera or other folder? We haven't played with Google Photos just yet, but we will get to that, as we would certainly like to provide easy backup/migration path from external apps.
From what I understand it doesn't make a folder like samsung gallery does, I guess it's something local that Google photos does but I'm not sure how an external application can access it... Oh well I'm back to Samsung gallery anyway, I don't need my photos on google, I'm using Storj for my personal stuff
Avatar
Hi, this is a general question for linux users. I recently installed Linux Mint 22 and tried to install S3 Driveapp. But all three possibilities (AppImage, Deb., and Flathub) did not work. So I tried to use Web version via Falkon browser. While now I'm able to upload files properly, when I tried to upload folders, it says "Dialog dismissed or directory not accessible". It is wierd, because if I try to upload files in the folder it works, but if I try to upload folder, it does not work. Is is a problem of Mint? Thanks!
Avatar
Unlawful Cactus 7/31/2024 9:40 AM
Only (not so) useful thing I have to say is I tried the AppImage one or two weeks ago on Linux Mint 20 and it also didn't run. It showed some error message in the terminal and that was that.
🥲 1
Avatar
Avatar
Unlawful Cactus
Only (not so) useful thing I have to say is I tried the AppImage one or two weeks ago on Linux Mint 20 and it also didn't run. It showed some error message in the terminal and that was that.
We've had a user here who reported that upgrading from Mint 20.3 to 21.3 did the job: https://discord.com/channels/1069654792902815845/1225088372964462695/1242743277200085144 we've considered this a win, and haven't really tried to fix the app for older (well not that old, but still) versions as it gets tricky to samelessly support all glibc, libmpv or fuse versions.
Avatar
Avatar
Ludwig
Hi, this is a general question for linux users. I recently installed Linux Mint 22 and tried to install S3 Driveapp. But all three possibilities (AppImage, Deb., and Flathub) did not work. So I tried to use Web version via Falkon browser. While now I'm able to upload files properly, when I tried to upload folders, it says "Dialog dismissed or directory not accessible". It is wierd, because if I try to upload files in the folder it works, but if I try to upload folder, it does not work. Is is a problem of Mint? Thanks!
I've moved this out to support item, let's continue there: https://discord.com/channels/1069654792902815845/1268291080244170844/1268291293616799836 (edited)
stayfrosty joined the server. 8/2/2024 7:17 AM
Timbo joined the server. 8/2/2024 7:39 AM
Avatar
Does anyone have any advice? I don't see how my endpoint is formatted incorrectly but maybe I'm missing something
Avatar
Avatar
myfrogger
Does anyone have any advice? I don't see how my endpoint is formatted incorrectly but maybe I'm missing something
That's a weird one, because your endpoint looks good. I've quickly tried with some spaces at the beginning/end and tabs inside, but S3Drive still can parse the endpoint correctly. What's your OS?
Avatar
Windows 10 Pro
Avatar
Avatar
myfrogger
Does anyone have any advice? I don't see how my endpoint is formatted incorrectly but maybe I'm missing something
By any chance, can you try Web? https://web.s3drive.app/loginS3
Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.
Avatar
Listing exiting buckets worked but some new errors appear when trying to connect. Is it possible that some remnants of some old version are causing problems since it had been so many months since I upgraded? (edited)
Avatar
Avatar
Tom
We've had a user here who reported that upgrading from Mint 20.3 to 21.3 did the job: https://discord.com/channels/1069654792902815845/1225088372964462695/1242743277200085144 we've considered this a win, and haven't really tried to fix the app for older (well not that old, but still) versions as it gets tricky to samelessly support all glibc, libmpv or fuse versions.
Unlawful Cactus 8/3/2024 4:10 PM
I thought the whole idea of the AppImage format is that it is self-contained, so you don't have to rely on the underlying system to provide a minimal version X of package Y?
Avatar
Avatar
Unlawful Cactus
I thought the whole idea of the AppImage format is that it is self-contained, so you don't have to rely on the underlying system to provide a minimal version X of package Y?
In most cases that's the case, however especially with glibc and its own dependencies it gets trickier... and the solution is actually to use the oldest possible OS to build the AppImage itself, but then app relies on libmpv2, whereas the older build system has only libmpv1 available and so on... and with FUSE I don't even remember the problem.
Pilotrama joined the server. 8/3/2024 6:20 PM
blast_hard_cheese joined the server. 8/4/2024 2:41 AM
Avatar
Avatar
Pilotrama
Click to see original message
rojo_salas joined the server. 8/4/2024 6:54 PM
Eyn joined the server. 8/5/2024 10:47 PM
Avatar
Hello S3Drive discord (。◕‿◕。)'ノ''
👋 4
Avatar
Avatar
dsus
Hello S3Drive discord (。◕‿◕。)'ノ''
I2rys (安全) 8/7/2024 5:32 AM
krishna joined the server. 8/7/2024 2:24 PM
Avatar
Hello, how does sync feature work on S3Drive phone app?, i have enabled but im confused how to use this?!
Avatar
Avatar
krishna
Hello, how does sync feature work on S3Drive phone app?, i have enabled but im confused how to use this?!
Hi, On Android sync works almost like in the desktop app. That is, folder sync is available and you can set up copy/sync/move from local folder to remote destination or vice versa. On iOS sync is limited to remote back-ends only, so it's only possible to copy data between your different clouds/accounts, but not necessarily from/to your phone. There is a platform specific permission issue that we need to solve. Do you have any specific question or would like to describe your use case, so we can assist your in setting things up?
Avatar
Avatar
Tom
Hi, On Android sync works almost like in the desktop app. That is, folder sync is available and you can set up copy/sync/move from local folder to remote destination or vice versa. On iOS sync is limited to remote back-ends only, so it's only possible to copy data between your different clouds/accounts, but not necessarily from/to your phone. There is a platform specific permission issue that we need to solve. Do you have any specific question or would like to describe your use case, so we can assist your in setting things up?
hello sir, i have turned on sync feature on android, but confused what to do next!!!?
Avatar
Avatar
krishna
hello sir, i have turned on sync feature on android, but confused what to do next!!!?
Can you please create #support item please? Please specify your OS version: Android/iOS and if possible post some screenshots. Please also le us know what are you trying to achieve. Perhaps media backup tool might suit you better depending on your needs. Thanks!
dinu30 joined the server. 8/9/2024 12:54 PM
mrcoati joined the server. 8/10/2024 9:47 AM
Kelin joined the server. 8/10/2024 3:58 PM
tingle_rescuer358 joined the server. 8/11/2024 10:30 AM
Avatar
Hi, firstly thanks for creating a privacy friendly, E2EE S3 and Rclone cloud storage compatible client. I was looking for one and found S3Drive to be promising. Hence, I purchased a monthly license on Android. But I noticed this purchase is not reflecting in Desktop app. Any way I can sync this purchase with Desktop app or with my account? Also, I am do planning to buy a lifetime license given the speedy progress I see in the app development. Is there any discount/deal coming up anytime soon😜 ?
quarkyup joined the server. 8/12/2024 11:56 AM
Avatar
Hey there 👋 I'm from Europe and the app doesn't seem to exist on my Appstore, is there a way to install it though ? Thanks 🙂
tb25 joined the server. 8/13/2024 12:11 PM
Avatar
Avatar
tb25
Click to see original message
Sticker
tb25 started a thread. 8/13/2024 12:15 PM
ButWhereIsEverybody🌌 joined the server. 8/13/2024 7:09 PM
Len joined the server. 8/13/2024 7:33 PM
Avatar
Avatar
quarkyup
Hey there 👋 I'm from Europe and the app doesn't seem to exist on my Appstore, is there a way to install it though ? Thanks 🙂
Are you by any chance located in France? Please see this: https://github.com/s3drive/app/issues/48
Avatar
Out of curiosity how big is the team maintaining s3drive?
Avatar
Avatar
tb25
Out of curiosity how big is the team maintaining s3drive?
I am the lead developer on this project with a huge help of my partner. We hope to get a part-time QA and marketing resource in 2025. By the end of 2025 we will be looking for an additional pair of hands to maintain client-side software, which would then allow us to focus on our own storage architecture for managed plans, so we can provide competitive data packages and reduce our operating costs (we're using rather costly external partner to store user's files, before we're ready with our own arrangements). It's still an early stage as you can see, but it's growing rather nicely. We're full time on this since 2022 and not stopping which you can probably guess from our growing changelog: https://s3drive.app/changelog I do hope you don't get discouraged by this, but that's our way of building a sustainable business model. We're profitable, but our current income doesn't allow fast expansion. We could possibly seek external funding / VC to build the proper team straight away, but that's not something we plan doing. We prefer to have freedom, control (with the help of the community) over the project roadmap and be free from investors pressure. (edited)
👍 1
Avatar
Avatar
Tom
I am the lead developer on this project with a huge help of my partner. We hope to get a part-time QA and marketing resource in 2025. By the end of 2025 we will be looking for an additional pair of hands to maintain client-side software, which would then allow us to focus on our own storage architecture for managed plans, so we can provide competitive data packages and reduce our operating costs (we're using rather costly external partner to store user's files, before we're ready with our own arrangements). It's still an early stage as you can see, but it's growing rather nicely. We're full time on this since 2022 and not stopping which you can probably guess from our growing changelog: https://s3drive.app/changelog I do hope you don't get discouraged by this, but that's our way of building a sustainable business model. We're profitable, but our current income doesn't allow fast expansion. We could possibly seek external funding / VC to build the proper team straight away, but that's not something we plan doing. We prefer to have freedom, control (with the help of the community) over the project roadmap and be free from investors pressure. (edited)
Thanks Tom for honest reply. no, you not discouraged at all. in fact you inspired 🙂 I paid for android app, now going to buy full version via website. I was looking for ages for such application which could run on linux. I used to be big proton fan, but they keep ignoring linux users so this is nice alternative to proton drive. hope these values will stay the same in the future as they are now. (edited)
💪 1
❤️ 2
Avatar
I'm keeping an eye on him, no worries. EyesSquint doggokek
jacobwinston joined the server. 8/14/2024 9:29 AM
Avatar
I2rys (安全) 8/14/2024 1:10 PM
S3Drive is simply the beshtt
💯 2
❤️ 1
felipao joined the server. 8/16/2024 6:20 PM
WindMagi joined the server. 8/17/2024 11:41 AM
newoutsider joined the server. 8/20/2024 9:07 PM
Dan joined the server. 8/21/2024 7:16 AM
Avatar
Hi. How do I get support for S3 Drive? Thanks.
Avatar
Avatar
Dan
Hi. How do I get support for S3 Drive? Thanks.
Hi @Dan, Feel free to create an item in our#support channel (edited)
MM0N0 joined the server. 8/22/2024 2:24 PM
M0N0 joined the server. 8/22/2024 2:25 PM
Avatar
Can't wait for the upcoming releases and its features! Planning to subscribe in the next few days! 🔥🔥🔥🔥 S3Drive is the best and has the best pricing!
❤️ 2
ntmfdp joined the server. 8/25/2024 8:27 AM
Avatar
Hi @ntmfdp 👋
Teddystacker joined the server. 8/27/2024 5:33 AM
mocs joined the server. 8/27/2024 7:25 AM
mocs joined the server. 8/27/2024 7:36 AM
Deleted User joined the server. 8/28/2024 10:22 AM
Nguyễn Tuấn Sơn joined the server. 8/28/2024 10:36 AM
Hikari joined the server. 8/29/2024 4:06 PM
Julia joined the server. 8/29/2024 5:51 PM
Majeskee/Majezik joined the server. 8/31/2024 12:28 AM
arthrod. joined the server. 8/31/2024 6:22 AM
konfiot joined the server. 8/31/2024 4:55 PM
Duke1010 joined the server. 9/2/2024 9:09 AM
Shyamal Chandra | A | USA (CST) joined the server. 9/3/2024 12:23 AM
OatMeal joined the server. 9/3/2024 11:44 AM
Avatar
Avatar
Julia
Click to see original message
zvan_fox joined the server. 9/3/2024 3:44 PM
Avatar
Avatar
zvan_fox
Click to see original message
Sticker
BrightEyes joined the server. 9/3/2024 11:38 PM
Vlkz joined the server. 9/4/2024 8:36 PM
Avatar
InfiniteAds559 9/5/2024 1:26 AM
Hey Tom, I'm trying out Kopia as a backup tool and I wonder if it's possible to view the encrypted back up using S3Drive?
AMEchan joined the server. 9/5/2024 1:41 AM
Avatar
Avatar
InfiniteAds559
Hey Tom, I'm trying out Kopia as a backup tool and I wonder if it's possible to view the encrypted back up using S3Drive?
It's not at the moment. Ciphers are similar, but not the same. We/Rclone uses: XSalsa20-Poly1305, Kopia uses: CHACHA20-POLY1305-HMAC-SHA256. It also uses different storage layout. https://kopia.io/docs/advanced/architecture/#content-addressable-block-storage-cabs and https://kopia.io/docs/advanced/architecture/#content-addressable-object-storage-caos that we would have to parse/decrypt and understand in order to produce file list viewable to the user. Definitely possible, but given our workload and other features we would spread ourselves too thin if we've started work on that 🙂 Added feature item though: https://s3drive.canny.io/feature-requests/p/add-suport-for-reading-kopia-backups
Fast and Secure Open-Source Backup Software for Windows, Mac, and Linux
xv joined the server. 9/5/2024 10:14 AM
timecaster joined the server. 9/5/2024 3:00 PM
Avatar
Hello. I wanted to reach out cause I was thinking about purchasing S3Drive to use with rclone. I have been doing this from the CLI, but a GUI app would be nice, especially for configuring bi-directional syncing for select folders and to more easily mount and manage an rclone encrypted folder. Since S3Drive isn't open source, I was trying to determine how much development time was being spent on the product from the changelog & feature requests. I do see new updates getting released, with even a new release today, but the feature requests are hard to tell what is actively being worked on.. with many in progress showing being marked as in progress over a year ago, then planned, and now in progress again. However... I was quite impressed with @Tom's discussion about ways to improve encryption and so I'm also happy to help support a developer working on contributing back improvements to rclone: https://github.com/rclone/rclone/issues/7192 I learned about this project from Flathub, but noticed there wasn't a manifest for WinGet or Brew. I wanted to inquire ahead of time before buying a lifetime subscription, if the developer(s) are in a spot to continue working on the project for an extended period of time. Also, if there is anything stopping the app from being distributed on WinGet or Brew, which might gain more user adoption? I haven't even downloaded the app yet to check for myself, but what programming language is it built around?
Ken joined the server. 9/7/2024 2:23 AM
Avatar
Avatar
Tom
It's not at the moment. Ciphers are similar, but not the same. We/Rclone uses: XSalsa20-Poly1305, Kopia uses: CHACHA20-POLY1305-HMAC-SHA256. It also uses different storage layout. https://kopia.io/docs/advanced/architecture/#content-addressable-block-storage-cabs and https://kopia.io/docs/advanced/architecture/#content-addressable-object-storage-caos that we would have to parse/decrypt and understand in order to produce file list viewable to the user. Definitely possible, but given our workload and other features we would spread ourselves too thin if we've started work on that 🙂 Added feature item though: https://s3drive.canny.io/feature-requests/p/add-suport-for-reading-kopia-backups
InfiniteAds559 9/7/2024 5:07 AM
Thanks for the detailed response, Tom. It's best that I stick with rclone then. I just like that Kopia has a GUI
CaptainVolcom joined the server. 9/7/2024 1:51 PM
indifferent1 joined the server. 9/7/2024 4:56 PM
Avatar
indifferent1 9/7/2024 4:57 PM
Hi, I want to cancel my subscription but I have not found a way to do it. Advice?
Avatar
Avatar
indifferent1
Hi, I want to cancel my subscription but I have not found a way to do it. Advice?
Hello, on which platform have you subscribed please? It will depend on the billing system you went through
Avatar
Avatar
Xenthys
Hello, on which platform have you subscribed please? It will depend on the billing system you went through
indifferent1 9/7/2024 6:24 PM
I signed up thru the website.
Avatar
Avatar
indifferent1
I signed up thru the website.
You should be able to access your account at https://s3drive.app/account then click on the View button to access your billing details on Stripe, where you can manage your subscription
Avatar
Avatar
Xenthys
You should be able to access your account at https://s3drive.app/account then click on the View button to access your billing details on Stripe, where you can manage your subscription
indifferent1 9/7/2024 6:39 PM
It’s not offering that option. It continues to try to hit my card even though it keeps being unsuccessful. (edited)
Avatar
The account you are connected to isn't subscribed, not through Stripe at least, if you paid through Stripe please see with @Tom who will certainly ask for your account email address to check it out
Avatar
indifferent1 9/7/2024 6:52 PM
I’m 90% certain I signed up thru the website and used stripe. This is the only detail I get from Apple wallet, as I’m using my Apple Cash balance.
Avatar
Avatar
Xenthys
The account you are connected to isn't subscribed, not through Stripe at least, if you paid through Stripe please see with @Tom who will certainly ask for your account email address to check it out
indifferent1 9/7/2024 7:21 PM
I just looked up on the stripe website, from the details they requested, and it does not appear to be billed thru them. EDIT: I just found the email, it is definately thru stripe. But it will only allow me to update the card information, not cancel. (edited)
Avatar
Hmm, yeah you'll need Tom to look into it then, I'm only a volunteer so I don't have access to any system
Avatar
indifferent1 9/7/2024 10:21 PM
Ok thank you, I sent a dm @Tom
10:21 PM
-
FinDub joined the server. 9/8/2024 9:10 AM
Avatar
Avatar
indifferent1
Ok thank you, I sent a dm @Tom
Hi, I would appreciate if you could provide me your e-mail address in the DM, so I can check if for you, make sure your subscription is cancelled and remove any outstanding charges. It's possible that you've cancelled the subscription after failed payment, in which case Stripe would repeat the charge until payment is settled. No worries though I will make sure that this doesn't bother you anymore. UPDATE: I've sent you DM, it's sorted now. Thanks for giving us a chance! (edited)
Gin joined the server. 9/9/2024 2:02 AM
howl joined the server. 9/9/2024 7:00 AM
Avatar
Avatar
timecaster
Hello. I wanted to reach out cause I was thinking about purchasing S3Drive to use with rclone. I have been doing this from the CLI, but a GUI app would be nice, especially for configuring bi-directional syncing for select folders and to more easily mount and manage an rclone encrypted folder. Since S3Drive isn't open source, I was trying to determine how much development time was being spent on the product from the changelog & feature requests. I do see new updates getting released, with even a new release today, but the feature requests are hard to tell what is actively being worked on.. with many in progress showing being marked as in progress over a year ago, then planned, and now in progress again. However... I was quite impressed with @Tom's discussion about ways to improve encryption and so I'm also happy to help support a developer working on contributing back improvements to rclone: https://github.com/rclone/rclone/issues/7192 I learned about this project from Flathub, but noticed there wasn't a manifest for WinGet or Brew. I wanted to inquire ahead of time before buying a lifetime subscription, if the developer(s) are in a spot to continue working on the project for an extended period of time. Also, if there is anything stopping the app from being distributed on WinGet or Brew, which might gain more user adoption? I haven't even downloaded the app yet to check for myself, but what programming language is it built around?
I do see new updates getting released, with even a new release today, but the feature requests are hard to tell what is actively being worked on..
Thanks for your message. As you can imagine scope of this project isn't small given the multiple platforms, mobile, E2E encryption model... and multiple clould providers support. The backlog of feature requests grows faster than our ability to deliver all of them, so we need to pick them smartly and if something proves to be challenging we stash it for later (that's why you might see Planned -> In progress -> then Planned again). Having said that, we're recently consumed by a pretty big item (Managed storage plans) which is side-quest that will allow us to get the additional revenue stream and hopefully increase our head count. Since we've promised to community (and ourselves !) to deliver it by the end of Q4 2024, for the past few months our 60% focus is solely on that. That doesn't mean that other features aren't implemented (https://s3drive.app/changelog), app is being actively developed, but it receives smaller upgrades, stability improvements, bugfixes (and lots of refactor is being worked which is paying back the debt we've took over past 2 years) as it benefits both external S3/Rclone endpoints, as well as our managed plans (which are technically ran using the S3 protocol). We could've made better job at updating status updates to give better indication what's worked on, but this proves to be challenging even for way bigger teams, especially when on top of S3Drive we need to keep doing R&D on external dependencies (we're proud that we can contribute back to some open-source projects https://github.com/rclone/rclone/issues/7192)
Avatar
Avatar
timecaster
Hello. I wanted to reach out cause I was thinking about purchasing S3Drive to use with rclone. I have been doing this from the CLI, but a GUI app would be nice, especially for configuring bi-directional syncing for select folders and to more easily mount and manage an rclone encrypted folder. Since S3Drive isn't open source, I was trying to determine how much development time was being spent on the product from the changelog & feature requests. I do see new updates getting released, with even a new release today, but the feature requests are hard to tell what is actively being worked on.. with many in progress showing being marked as in progress over a year ago, then planned, and now in progress again. However... I was quite impressed with @Tom's discussion about ways to improve encryption and so I'm also happy to help support a developer working on contributing back improvements to rclone: https://github.com/rclone/rclone/issues/7192 I learned about this project from Flathub, but noticed there wasn't a manifest for WinGet or Brew. I wanted to inquire ahead of time before buying a lifetime subscription, if the developer(s) are in a spot to continue working on the project for an extended period of time. Also, if there is anything stopping the app from being distributed on WinGet or Brew, which might gain more user adoption? I haven't even downloaded the app yet to check for myself, but what programming language is it built around?
if there is anything stopping the app from being distributed on WinGet or Brew, which might gain more user adoption?
We'll support more distribution channels in the future.
what programming language is it built around?
It's Flutter/Dart with lots of native code, including Swift/Kotlin, but also Golang for some components.
RemArt⭐ joined the server. 9/9/2024 9:17 AM
flana joined the server. 9/9/2024 10:18 PM
wpdlatm joined the server. 9/10/2024 9:53 AM
doni joined the server. 9/10/2024 2:17 PM
Doni joined the server. 9/10/2024 2:22 PM
Avatar
Hello. Am I correct in thinking that the ability to sync files (2-way) from iOS <--> S3 (Wasabi) is still in the works? My local directory isn't selectable when I try to set up a sync and just want to make sure I'm not doing something wrong. This application is killer by the way! S3 and Rclone compatible? Awesome. (edited)
👍 1
ffggtt joined the server. 9/10/2024 4:04 PM
Avatar
Avatar
doni
Hello. Am I correct in thinking that the ability to sync files (2-way) from iOS <--> S3 (Wasabi) is still in the works? My local directory isn't selectable when I try to set up a sync and just want to make sure I'm not doing something wrong. This application is killer by the way! S3 and Rclone compatible? Awesome. (edited)
Yep, unfortunately it's still not possible to select local directory on iOS. 2-way sync on iOS would work between two remotes, but I guess it's not that useful. We will get to that eventually 💪
🙏 1
Avatar
Hi all - I was looking at the properties of my workflow and how to start using S3Drive instead of what I am doing. My current workflow is based on a LUKS encrypted vault that I mount at will on my linux machines. The thing that I really like of it is that it is encrypted until I needed (aka - files are never "live"). This adds yet another layer of security (maybe unnecessary). I was wondering if S3Drive 2FA would end up doing something similar to this (aka decrypting/opening the vault only when necessary) ?
Avatar
Avatar
Ari
Hi all - I was looking at the properties of my workflow and how to start using S3Drive instead of what I am doing. My current workflow is based on a LUKS encrypted vault that I mount at will on my linux machines. The thing that I really like of it is that it is encrypted until I needed (aka - files are never "live"). This adds yet another layer of security (maybe unnecessary). I was wondering if S3Drive 2FA would end up doing something similar to this (aka decrypting/opening the vault only when necessary) ?
Hi, LUKS and S3Drive have some things in common, but they're completely different beasts with different guarantees and accessibility. In principle S3Drive aims to convert 3rd party cheap S3 storage as a secure place for your files, but it doesn't encrypt/decrypt your files locally - it relies on your OS security (whether LUKS, BitLocker, FileVault etc.). With LUKS, the 1st factor it the access to your machine (either physical or by other software on your machine) since such data isn't stored anywhere online. 2nd factor is the encryption password to your encrypted encryption key. With S3Drive, the 1st factor is access to your machine (similarly to the above), but also possession of access key/secret or direct access to your data by your S3 provider. 2nd factor is the encryption password as well. LUKS keeps encryption key in your RAM only when vault is opened. Once vault is closed then encryption key remains encrypted on your disk (only password that you provide can open it). If your LUKS vault is closed it's hard to beat its security, but if your machine is compromised then the moment you open the vault and type your password the attacker can potentially access your data. With S3Drive your encryption password (2FA) remains stored in the Keychain/Libsecret and relies on OS security to get it out. This is so you don't need to constantly type your password (as it's the case with the LUKS). In any case if your machine is compromised then both S3Drive and LUKS won't help you (unless you never open the LUKS vault). There are couple other items where we aim to improve security (e.g. protect credentials in local Rclone config that we create): https://s3drive.canny.io/feature-requests/p/rclone-encrypted-config
Avatar
Avatar
Ari
Hi all - I was looking at the properties of my workflow and how to start using S3Drive instead of what I am doing. My current workflow is based on a LUKS encrypted vault that I mount at will on my linux machines. The thing that I really like of it is that it is encrypted until I needed (aka - files are never "live"). This adds yet another layer of security (maybe unnecessary). I was wondering if S3Drive 2FA would end up doing something similar to this (aka decrypting/opening the vault only when necessary) ?
Not to confuse the above with 2FA feature that we will be implementing (https://s3drive.canny.io/feature-requests/p/implement-2fa) The one in this feature request is about protecting the access to the S3 managed account (storage plans that we'll provide), but in a context of the above discussion is just an additional factor to get the raw data access, where your true 2nd factor would be E2E encryption password (Rclone compatible) that you set up in the Profile settings. I hope that this is useful to better understand the differences between S3Drive / LUKS. (edited)
Avatar
In any case if your machine is compromised then both S3Drive and LUKS won't help you (unless you never open the LUKS vault).
This is exactly what I do there - I never open the vault (unless I need to add/read files obviously) and when I am done I close the vault and push the LUKS file to S3. This gives me more protection against attackers that have access to my machine. I was wondering if S3Drive would provide a similar experience (it definitely could!) with 2FA but thanks for confirming it is not going to be the same 😄 @Tom
Avatar
Avatar
Ari
In any case if your machine is compromised then both S3Drive and LUKS won't help you (unless you never open the LUKS vault).
This is exactly what I do there - I never open the vault (unless I need to add/read files obviously) and when I am done I close the vault and push the LUKS file to S3. This gives me more protection against attackers that have access to my machine. I was wondering if S3Drive would provide a similar experience (it definitely could!) with 2FA but thanks for confirming it is not going to be the same 😄 @Tom
We could technically introduce a mode where encryption password isn't stored anywhere on disk (or even secure chip / keychain), but kept in RAM (in a similar way to LUKS), once you close the app you would have to provide this password once again. Not sure at this stage if this would be feasible to achieve with Rclone config encryption (we rely on Rclone for couple in-app functions): https://rclone.org/commands/rclone_config_encryption_check/ (edited)
Avatar
Yeah supporting it in S3Drive would be awesome - Maybe I have another way but it is probably coincidental - I am using KeepassXC as keyring and that requires a password (a dialog pops if the password database is closed) - that can work "as a vault" because S3Drive would not receive the actual password until KeepassXC is unlocked
Avatar
Avatar
Ari
Yeah supporting it in S3Drive would be awesome - Maybe I have another way but it is probably coincidental - I am using KeepassXC as keyring and that requires a password (a dialog pops if the password database is closed) - that can work "as a vault" because S3Drive would not receive the actual password until KeepassXC is unlocked
2:24 PM
yeah rclone config should definitely be encrypted as well for that to work good point!
Flashie joined the server. 9/11/2024 5:20 PM
Avatar
InfiniteAds559 9/12/2024 5:13 PM
Regarding the local mount feature, do apps with all files permission see the files on the remote mount or do apps only see the files that are stored locally?
Avatar
Avatar
InfiniteAds559
Regarding the local mount feature, do apps with all files permission see the files on the remote mount or do apps only see the files that are stored locally?
What OS do you refer to? In principle other apps would be able to view the files in the mount, since they would run using the same OS user as mount itself. Unless you refer to Android, in such case other apps wouldn't see the mount - sandboxing on mobile works differently than on desktop.
Avatar
Avatar
Tom
What OS do you refer to? In principle other apps would be able to view the files in the mount, since they would run using the same OS user as mount itself. Unless you refer to Android, in such case other apps wouldn't see the mount - sandboxing on mobile works differently than on desktop.
InfiniteAds559 9/13/2024 12:25 AM
MacOs & Android
Adz joined the server. 9/15/2024 5:22 AM
shaike joined the server. 9/15/2024 6:53 AM
shy joined the server. 9/15/2024 6:55 AM
6:56 AM
I really like this app , I wanted to know I haven noticed that if I buy lifetime for all platforms google drive is supported. it means that it will be also supported on the Android version ?
ThHirsch joined the server. 9/15/2024 10:46 AM
Avatar
whom could answer this ?
Avatar
Unlawful Cactus 9/15/2024 9:42 PM
Hi, could it be the latest Android update broke "Start sync after app starts"? I start S3Drive every night around the same time to sync everything, which always happens automatically after opening the app. But since yesterday this doesn't happen anymore and I need to tap stop/start on each folder pair to start syncing manually. Android 14, S3Drive 1.9.11, syncing between local and Rclone remotes.
9:44 PM
"Start sync after app starts" is still enabled by the way, switching it off and back on didn't help, I also rebooted my phone with no luck.
cronicmstrb8r__ joined the server. 9/15/2024 11:47 PM
Avatar
Avatar
shy
I really like this app , I wanted to know I haven noticed that if I buy lifetime for all platforms google drive is supported. it means that it will be also supported on the Android version ?
Yes it would be supported on all platforms, including Android. Small exception is that it doesn't yet work on iOS, but it's due to technical issues that we need to find solution for: https://s3drive.canny.io/feature-requests/p/fix-google-drive-gcs-ftp-and-sftp-missing-on-ios
Avatar
Avatar
Unlawful Cactus
Hi, could it be the latest Android update broke "Start sync after app starts"? I start S3Drive every night around the same time to sync everything, which always happens automatically after opening the app. But since yesterday this doesn't happen anymore and I need to tap stop/start on each folder pair to start syncing manually. Android 14, S3Drive 1.9.11, syncing between local and Rclone remotes.
Thanks for that report. I am going to check that out with our team. We've recently pushed couple improvements to Sync in general, there is a small chance that a bug slipped in here. I will let you know later today ! UPDATE: We've identified the problem. This will be fixed in a 1.9.12 release which is now being released. On Android it may take a little bit longer as we're awaiting approval from the Google Play team. (edited)
Avatar
Avatar
Unlawful Cactus
Hi, could it be the latest Android update broke "Start sync after app starts"? I start S3Drive every night around the same time to sync everything, which always happens automatically after opening the app. But since yesterday this doesn't happen anymore and I need to tap stop/start on each folder pair to start syncing manually. Android 14, S3Drive 1.9.11, syncing between local and Rclone remotes.
Out of curiosity, how do you start sync? Some external trigger or you start app manually?
Avatar
Avatar
Tom
Thanks for that report. I am going to check that out with our team. We've recently pushed couple improvements to Sync in general, there is a small chance that a bug slipped in here. I will let you know later today ! UPDATE: We've identified the problem. This will be fixed in a 1.9.12 release which is now being released. On Android it may take a little bit longer as we're awaiting approval from the Google Play team. (edited)
Unlawful Cactus 9/16/2024 11:12 AM
Awesome!
Avatar
Avatar
Tom
Out of curiosity, how do you start sync? Some external trigger or you start app manually?
Unlawful Cactus 9/16/2024 11:20 AM
Basically manually, but slightly automated. I have Tasker, an automation app, notify me at ten o'clock, and when I tap the notification it opens S3Drive and then the sync screen by emulating user input so I can see the syncing happening. Is there a better way currently? Like an intent or something?
Avatar
Unlawful Cactus 9/16/2024 11:27 AM
Or can sync now run in the background at the specified interval? Before, there was a note somewhere in the app saying this didn't work yet.
Avatar
Avatar
Unlawful Cactus
Basically manually, but slightly automated. I have Tasker, an automation app, notify me at ten o'clock, and when I tap the notification it opens S3Drive and then the sync screen by emulating user input so I can see the syncing happening. Is there a better way currently? Like an intent or something?
I haven't tried myself, but opening this URL/intent: s3drive://sync might actually open the Sync screen directly without necessary user input in the drawer.
Avatar
Avatar
Unlawful Cactus
Or can sync now run in the background at the specified interval? Before, there was a note somewhere in the app saying this didn't work yet.
Background mode isn't yet supported, however we plan to add it in few months. We don't exactly now what might surprise us at this stage though. At the moment we're awaiting outstanding fix to 1.9.11 release as well which aims to fix the background (for media uploads) after Android 14 imposed certain restrictions and it's broke since we updated SDK recently. We were forced by Google to use latest SDK by the end of August ... but our existing background processing approach specific approval from Google: https://developer.android.com/about/versions/14/behavior-changes-14#fgs-types and https://stackoverflow.com/a/77186316 (edited)
Avatar
Avatar
Tom
I haven't tried myself, but opening this URL/intent: s3drive://sync might actually open the Sync screen directly without necessary user input in the drawer.
Unlawful Cactus 9/16/2024 1:04 PM
Nope, that doesn't work. (edited)
Avatar
Avatar
Unlawful Cactus
Nope, that doesn't work. (edited)
We'll look into this. In principle app is prepared to handle intents.
Brad joined the server. 9/17/2024 3:30 AM
Avatar
Hey 👋🏻 I was previously using Google Drive but want to move away from Google as much as possible. S3Drive looks great and I love how I can essentially "self-host" with it by using any S3 Compatible storage 👌🏻 FYI the Discord link in the website footer is broken - it seems to embed a channel from this server instead of linking to the invite url (edited)
👍 1
Luis joined the server. 9/17/2024 11:03 AM
bastiaan9882 joined the server. 9/17/2024 10:47 PM
JuergenHH joined the server. 9/18/2024 7:43 AM
Avatar
Avatar
Unlawful Cactus
Hi, could it be the latest Android update broke "Start sync after app starts"? I start S3Drive every night around the same time to sync everything, which always happens automatically after opening the app. But since yesterday this doesn't happen anymore and I need to tap stop/start on each folder pair to start syncing manually. Android 14, S3Drive 1.9.11, syncing between local and Rclone remotes.
Version 1.9.12 is now released, this shall be resolved by now. Thanks for your report!
🎉 1
TheByteBolt joined the server. 9/18/2024 7:19 PM
stevek joined the server. 9/19/2024 12:14 AM
niiqo joined the server. 9/19/2024 10:42 AM
MongMadona MN joined the server. 9/19/2024 3:33 PM
🤯 Zaphod Beeblebrox 🤯 joined the server. 9/19/2024 4:22 PM
Avatar
Avatar
🤯 Zaphod Beeblebrox 🤯
Click to see original message
🤯 Zaphod Beeblebrox 🤯 9/19/2024 4:22 PM
Sticker
4:23 PM
Hi. I have a general question, should I post it here, or make a post in #support
Avatar
Avatar
🤯 Zaphod Beeblebrox 🤯
Hi. I have a general question, should I post it here, or make a post in #support
Hi! General question probably falls here, if it turns out to be the support then we'll move to #support.
Avatar
🤯 Zaphod Beeblebrox 🤯 9/19/2024 4:30 PM
Ok thanks @Tom So a little background. I was using IBM's cloud object storage because it allowed 25GB free, but they are doing away with this plan. I wanted to see how S3Drive would work. I like it so far. There is one thing I am used to doing, and I'm not sure if it's even possible. So I have files I want to stream, like video. With IBM's cloud object storage I could access the files with a direct URL and load those in to VLC, where it would stream directly, without downloading. In S3drive I have uploaded some video files, and I've used the feature of Open With... where I select VLC. However, it has to download the file locally, and then it starts playing. Is there anyway to replicate what I was doing before, where I can generate links to the files stored in S3Drive?
4:31 PM
Or is that more dependent on the cloud storage provider's capabilities?
Avatar
Yes indeed, you would right-click, use Sharing and choose: "Preshared URL". It will generate a URL which is valid for maximum 7 days. Preshared URLs are native S3, so in principle every provider supports that.
Avatar
Avatar
🤯 Zaphod Beeblebrox 🤯
Ok thanks @Tom So a little background. I was using IBM's cloud object storage because it allowed 25GB free, but they are doing away with this plan. I wanted to see how S3Drive would work. I like it so far. There is one thing I am used to doing, and I'm not sure if it's even possible. So I have files I want to stream, like video. With IBM's cloud object storage I could access the files with a direct URL and load those in to VLC, where it would stream directly, without downloading. In S3drive I have uploaded some video files, and I've used the feature of Open With... where I select VLC. However, it has to download the file locally, and then it starts playing. Is there anyway to replicate what I was doing before, where I can generate links to the files stored in S3Drive?
Caveat is that preshared URLs would only support unencrypted files that way (unless VLC can decrypt files via some plugin), whereas in-app player within S3Drive can also stream encrypted files, because the stream decryption is built-in.
4:35 PM
Avatar
🤯 Zaphod Beeblebrox 🤯 9/19/2024 4:37 PM
Hmm, I don't see the Sharing option This is on MacOS, but I also don't see the option on iOS.
Avatar
If you use S3Drive's built-in test storage, then sharing option isn't available just yet. If you connect to external S3 (or use Rclone back-end), then such option shall appear as long as you select files (not folders). Preshared sharing generation is available for single file at a time. https://docs.s3drive.app/setup/providers/
Personal storage compatible with S3, WebDav and 70+ other Rclone back-ends
Avatar
🤯 Zaphod Beeblebrox 🤯 9/19/2024 4:40 PM
Ah ok I think that's it then. I was just testing with S3Drive's test storage. Thanks, I'll play around and find what works 🙂
Avatar
🤯 Zaphod Beeblebrox 🤯 9/19/2024 8:45 PM
Ok I found a cloud storage provider that works. I tried Oracle (omg that was a lot to setup, most complicated I've had to do), but couldn't figure out how to generate links. Cloudflare was so much easier to setup. They have 10 GB free tier.
Rodrigo Oliveira joined the server. 9/19/2024 8:48 PM
Avatar
Avatar
Rodrigo Oliveira
Click to see original message
🤯 Zaphod Beeblebrox 🤯 9/19/2024 9:01 PM
noe joined the server. 9/20/2024 3:29 AM
CamBarkRo joined the server. 9/21/2024 12:25 PM
Avatar
Hey hi guys, it's good to have a app like s3 drive and thanks for your work. I was trying to connect with my aws s3 bucket using accesskey and secretkey in s3drive app, but I couldn't able to connect with my bucket. Tried to create a bucket from s3drive app but unfortunately that's also not working. Is it possible to connect with my aws s3 bucket directly, if yes then please guide me to do it.
Avatar
Avatar
CamBarkRo
Hey hi guys, it's good to have a app like s3 drive and thanks for your work. I was trying to connect with my aws s3 bucket using accesskey and secretkey in s3drive app, but I couldn't able to connect with my bucket. Tried to create a bucket from s3drive app but unfortunately that's also not working. Is it possible to connect with my aws s3 bucket directly, if yes then please guide me to do it.
Hi ! Can you please create #support item? Please post screenshot/text of the error that you get. Please also include what "endpoint" you use to connect to the AWS S3 and whather you've configured region that matches your AWS region.
Avatar
Avatar
Tom
Hi ! Can you please create #support item? Please post screenshot/text of the error that you get. Please also include what "endpoint" you use to connect to the AWS S3 and whather you've configured region that matches your AWS region.
Adding custom region makes sense, thank you for your quick reply.
Avatar
InfiniteAds559 9/22/2024 12:42 AM
For those of you using rclone mount on MacOS, which option (MacFUSE, FUSE-T, or NFS mount) did you go with? And why? (edited)
Philippe joined the server. 9/24/2024 7:07 AM
Avatar
Avatar
Philippe
Click to see original message
Avatar
Hello there! I'm trying to find an easy-to-use cloud photo solution for my family. One of my relatives likes to take photos, import them to his iPad and do some basic editing. We had been using Google Photos, but editing had always been problematic because there is no way to fetch media in Google Photos through the native iOS Files app. Furthermore, that relative always had a hard time understanding how to re-upload edited files and removing the original. So we moved to OneDrive, which allows for access in the native iOS Files app, and the PhotoSync app, which allowed for local copies of the media to be deleted after a transfer. However, OneDrive is very unpolished when it comes to photo management in my opinion, as well as collaborating on a shared album (you simply can't). Also, PhotoSync has been quite complicated to maintain due to the number of settings, somewhat unintuitive UI, and updates breaking things occasionally. I was thinking of moving back to the Google ecosystem with Google Drive instead. I discovered this app (S3Drive) in the process and it looks like a very nice project. I have a dilemma tho:
  • Should we go for Google Drive and one of Google One's subscription plans? The perks that come with it are somewhat interesting and it's priced competitively.
  • Or could S3Drive's upcoming hosted subscription plans be compatible with our use case? Being able to collaborate on shared albums (or folders) will be a must for us. Any advice would be welcome!
(edited)
Avatar
Hi @Philippe, It really depends how much you value privacy and convenience and how you manage your photos. S3Drive at this stage isn't a photo management solution, however it's a great tool if you would like to simply backup your photos from your phone and/or sync your albums (currently simply folders) to a different location/locations (for redundancy purposes). For instance you can backup your photos from S3Drive, but then you might decide to clean up some of them on your phone. There isn't mechanism (in backup functionality) to delete them on the other end. You would need to use the S3Drive Sync (this sync changes as well) and then select local folder (this isn't yet supported on iOS though). We certainly aim to catch up in these areas, but it will take us some time before on top of file management tools we gear up with media specific ones. In the meantime you might also give https://ente.io/ a go. I haven't tried it myself, but it's basically E2E encrypted photo management solution. (edited)
Protect your photos and videos with Ente - a secure, cross-platform, open source, encrypted photo storage app. Automatic backups, end-to-end encryption, collaborative albums, family plans, free trial, library-sync, 1-click import, human support, locked photos, live photos, descriptions, private sharing, search and more.
Avatar
Hey Tom, thank you for the reply. I'm really looking into S3Drive for the sync specifically, and I don't mind if it's not designed for photos specifically. In fact, I'd prefer if files are synced as they are, so I never really cared about all the media-specific features (EXIF data, etc.) that PhotoSync offers. Would S3Drive be at least suitable for manual move (delete after transfer) of media files from iOS/Android to Google Drive?
8:22 AM
I've heard about ente photos and already use their 2FA app but I'd prefer something a bit more mature and supported by different apps/services
Avatar
Avatar
Philippe
Hey Tom, thank you for the reply. I'm really looking into S3Drive for the sync specifically, and I don't mind if it's not designed for photos specifically. In fact, I'd prefer if files are synced as they are, so I never really cared about all the media-specific features (EXIF data, etc.) that PhotoSync offers. Would S3Drive be at least suitable for manual move (delete after transfer) of media files from iOS/Android to Google Drive?
S3Drive supports multiple back-ends including Google Drive: https://docs.s3drive.app/setup/providers/ Caveat, on iOS, Google Drive isn't yet supported - https://s3drive.canny.io/feature-requests/p/fix-google-drive-gcs-ftp-and-sftp-missing-on-ios) You could then use: "Media backup" functionality to backup your local photos to selected back-end. Your photos will end up in: "Automatic upload" location (this can be changed in the settings). Deleting them on your phone won't affect the: "Automatic upload" location, but you can manually delete them directly from the S3Drive UI, as technically it's just a folder with files. On top of that if you configured e.g. Google Drive and Dropbox let's say, then you can configure Sync/Copy/Move between them directly from your phone/desktop client. I am not sure if this is what you've asked about? (edited)
Avatar
I'm basically looking for an equivalent to the "delete after transfer" option of PhotoSync; it transfers media files to the cloud storage (i.e., we were using OneDrive), and then immediately asks if we want to delete the uploaded media from the local device (i.e., the iPad). I thought that this was what the "move" operation in S3Drive amounted to. But if I understand correctly, the "move" action is only applicable to transfers between backends? Not from local device to backend? And for Google Drive on iOS, do you have an approximate ETA for when it will be added?
Bacco joined the server. 9/24/2024 12:56 PM
Bacco joined the server. 9/24/2024 12:58 PM
Avatar
Unlawful Cactus 9/24/2024 6:35 PM
I’m testing the iOS version of S3Drive and it looks like there’s no easy way to navigate up one level in the file browser? I.e. go back to the previous folder? On Android I just use the back gesture, but on iOS the back gesture just opens the side menu/app drawer. The only way to navigate up is through the breadcrumb bar at the top, which quickly becomes a hassle once you’re a few levels deep. Am I missing something or is this just how it is on iOS?
Avatar
Avatar
Unlawful Cactus
I’m testing the iOS version of S3Drive and it looks like there’s no easy way to navigate up one level in the file browser? I.e. go back to the previous folder? On Android I just use the back gesture, but on iOS the back gesture just opens the side menu/app drawer. The only way to navigate up is through the breadcrumb bar at the top, which quickly becomes a hassle once you’re a few levels deep. Am I missing something or is this just how it is on iOS?
You could use breadcrumbs. Once you're inside subfolder you would see something like this e.g. Files > folder > subfolder. If you tap on folder you would go one level up. In some cases the level might be hidden behind: ... if there isn't enough space in this bar, in such case you can tap it to unhide it and then swipe left/right to see all levels.
Avatar
Avatar
Philippe
I'm basically looking for an equivalent to the "delete after transfer" option of PhotoSync; it transfers media files to the cloud storage (i.e., we were using OneDrive), and then immediately asks if we want to delete the uploaded media from the local device (i.e., the iPad). I thought that this was what the "move" operation in S3Drive amounted to. But if I understand correctly, the "move" action is only applicable to transfers between backends? Not from local device to backend? And for Google Drive on iOS, do you have an approximate ETA for when it will be added?
In principle that would be "Move" action as you say, the issue is that it's designed to work on local file systems (e.g. desktop) not on the virtual overlay that mobile expose to developers. On iOS we don't have access to filesystem whatsoever, so currently the: "Local" option is grayed out in Sync. On Android we can actually "Move" files, since we've received the: https://developer.android.com/training/data-storage/manage-all-files permission. The "delete after transfer" feature would have to be developed separately, specifically for iOS using Apple frameworks. We will get to that, but unlikely this year. I've added feature item to track this: https://s3drive.canny.io/feature-requests/p/delete-media-after-transfer We don't have ETA on Google Drive. In principle it should work, because it's already implemented by library that we're using: https://rclone.org/drive/ unfortunately we get some low-level compile issues that we didn't have time to address. There is a chance it will be a quick one, it just we need to dedicate some time to it.
🙌 1
deqhiem joined the server. 9/25/2024 9:40 AM
Avatar
Avatar
deqhiem
Click to see original message
strellic joined the server. 9/26/2024 4:23 AM
Basik_Black joined the server. 9/26/2024 4:23 AM
Avatar
Avatar
Basik_Black
Click to see original message
Gabriele Zanichelli joined the server. 9/27/2024 5:03 AM
Avatar
Avatar
Tom
You could use breadcrumbs. Once you're inside subfolder you would see something like this e.g. Files > folder > subfolder. If you tap on folder you would go one level up. In some cases the level might be hidden behind: ... if there isn't enough space in this bar, in such case you can tap it to unhide it and then swipe left/right to see all levels.
Unlawful Cactus 9/27/2024 5:35 PM
Hey Tom, thanks, I got that, it's very cumbersome 😅 Phone screens are narrow and the path bar isn't even using the full width, so it'll often come down to tapping the …, scrolling all the way to the end, locating the last / and tapping the folder name in front of that. Every. Single. Time. In comparison, my whole life I've navigated up with just one gesture, key combination or the click or tap of a button or .. entry atop the files list, which is effortless. (Okay, in the early 1990s it was "cd.. ENTER" but even that was faster 😄) Navigation feels broken in S3Drive on iPhone to me, which I guess is somewhat due to the cross platform development approach (which works for Android but not iPhone). It is nice to have an iOS client at all though! 🙏🏻 I think the path bar in S3Drive, at least on mobile, could be improved to solve this. Have a look at the accompanying screenshots, all showing a folder called "WhatsApp Profile Photos", deep down in the directory structure. In S3Drive, the path bar provides almost no information. It appears we are in a folder called "WhatsApp Profile" but this is not true. The folder name is actually truncated but there is no indication of this. It's even worse when I browse the sibling folder "WhatsApp Stickers": the path bar shows "Files > ... > WhatsApp" (omitting the Stickers part). Very misleading. And that's all the information we get from the path bar. Compare this to AOSP Files and Google Files. Both show a path bar with the untruncated folder names of the current, parent and grandparent folders. Which is also directly scrollable. And can be used to navigate up one or multiple levels with a single tap (which would solve my issue with S3Drive on iPhone). (edited)
5:35 PM
Alternatively, iOS Files shows the full directory name and "< Back" next to it to navigate up with one tap. When tapping the folder name or holding the back button, we get a list of breadcrumbs to quickly navigate multiple levels up. Both Android and iOS default file managers provide a frictionless interface independent of gesture navigation. I hope this is useful feedback. If not, let me know and I'll keep it to myself next time. I'd hate to be a bother 🙏🏻 (edited)
Avatar
Avatar
Unlawful Cactus
Hey Tom, thanks, I got that, it's very cumbersome 😅 Phone screens are narrow and the path bar isn't even using the full width, so it'll often come down to tapping the …, scrolling all the way to the end, locating the last / and tapping the folder name in front of that. Every. Single. Time. In comparison, my whole life I've navigated up with just one gesture, key combination or the click or tap of a button or .. entry atop the files list, which is effortless. (Okay, in the early 1990s it was "cd.. ENTER" but even that was faster 😄) Navigation feels broken in S3Drive on iPhone to me, which I guess is somewhat due to the cross platform development approach (which works for Android but not iPhone). It is nice to have an iOS client at all though! 🙏🏻 I think the path bar in S3Drive, at least on mobile, could be improved to solve this. Have a look at the accompanying screenshots, all showing a folder called "WhatsApp Profile Photos", deep down in the directory structure. In S3Drive, the path bar provides almost no information. It appears we are in a folder called "WhatsApp Profile" but this is not true. The folder name is actually truncated but there is no indication of this. It's even worse when I browse the sibling folder "WhatsApp Stickers": the path bar shows "Files > ... > WhatsApp" (omitting the Stickers part). Very misleading. And that's all the information we get from the path bar. Compare this to AOSP Files and Google Files. Both show a path bar with the untruncated folder names of the current, parent and grandparent folders. Which is also directly scrollable. And can be used to navigate up one or multiple levels with a single tap (which would solve my issue with S3Drive on iPhone). (edited)
I hope this is useful feedback. If not, let me know and I'll keep it to myself next time. I'd hate to be a bother
Thanks for your feedback. No it doesn't bother us, it's the exact opposite, we certainly prefer to hear directly from our users regardless if it's a comment or criticism instead of trying to read in their minds. I think I understand your points, I've created feature item and suggested these 3 solutions, what do you think about them? https://s3drive.canny.io/feature-requests/p/improve-breadcrumbs-easy-way-to-leave-folder a) Modify breadcrumbs to show current folder, its direct parent and hide behind toggleable: "..." any levels that didn't fit. At the moment first (Files) and the last level (current folder) is always shown and middle part of the breadcrumbs gets shortened to: "...", upon tap it opens up and creates horizontally scrollable widget, but it starts always from the left (top upward folder) forcing user to scroll right to get the immediate parent. b) Instead of hamburger icon think of using back arrow on iOS, c) Consider moving breadcrumbs to a new bar.
On Android user can use back gesture to move up in the folder hierarchy. On iOS back gesture isn't available, so user is more reliant on breadcrumb experience
Яша Лава joined the server. 9/27/2024 11:52 PM
beanzii joined the server. 9/28/2024 10:47 AM
be_wholesome joined the server. 9/29/2024 5:30 PM
Avatar
Avatar
Tom
I hope this is useful feedback. If not, let me know and I'll keep it to myself next time. I'd hate to be a bother
Thanks for your feedback. No it doesn't bother us, it's the exact opposite, we certainly prefer to hear directly from our users regardless if it's a comment or criticism instead of trying to read in their minds. I think I understand your points, I've created feature item and suggested these 3 solutions, what do you think about them? https://s3drive.canny.io/feature-requests/p/improve-breadcrumbs-easy-way-to-leave-folder a) Modify breadcrumbs to show current folder, its direct parent and hide behind toggleable: "..." any levels that didn't fit. At the moment first (Files) and the last level (current folder) is always shown and middle part of the breadcrumbs gets shortened to: "...", upon tap it opens up and creates horizontally scrollable widget, but it starts always from the left (top upward folder) forcing user to scroll right to get the immediate parent. b) Instead of hamburger icon think of using back arrow on iOS, c) Consider moving breadcrumbs to a new bar.
Unlawful Cactus 9/30/2024 2:00 PM
Yeah, looks like you got it. If it were me I would do a) and c). You develop one interface for all platforms right? I think the Android style breadcrumb bar—including giving it more space by moving it down—will work everywhere. Then the area where it currently sits can just say "Files", making it coherent with the other screens which also have the screen title (Transfers, Sync, Profile settings etc.) there. If you do customize for individual platforms, implementing the iOS back gesture would be great of course, making iOS users feel more at home and less like they're using an Android app on their iPhone, while also making one-handed use much easier. "On iOS back gesture isn't available" isn't exactly true in general, but maybe you're referring to the current state of the app.
👍 1
2:05 PM
O, and instead of replacing the part of the path that doesn't fit on screen with …, just making the path bar scrollable right away instead—like Android Files does—provides an even better user experience I'd say. As long as it starts out by having the end of the path in focus of course.
jacobisreal joined the server. 10/1/2024 7:40 AM
ubione joined the server. 10/1/2024 7:43 AM
Avatar
Avatar
jacobisreal
Click to see original message
Avatar
i have signed up for an ultimate account, paid a year, and not a single one of the client install options for linux has worked.
7:45 AM
i've done the .deb, flatpak, AppImage ... none work. they dont run at startup and wont mount via fuse on my variant of ubuntu / deb
Avatar
I see you've opened a #support thread that has been handled, thanks a lot for your cooperation
Avatar
When will be another Language on S3Drive App such as traditional Chinese etc.
jovial_quokka_60260 joined the server. 10/2/2024 7:55 AM
mgman joined the server. 10/3/2024 12:30 PM
robotbm joined the server. 10/3/2024 12:35 PM
Avatar
Hi there, just join. And got the Ultimate life time package to support your work.
12:42 PM
I am very interesed to get be able to store data from the iphone to some remote drive via S3Drive. Thus I heavily support your plan to integrate, iOS mount/files integration. Since I am in desparate need to upload Voice Memos and alike to a secure location.
12:47 PM
WHatz I would love to have integrated is the rclone config password, so it asks me for it every time I want to connect to my secure files. As it si setup not if yomebody gets to the dump file one has full access. THis is not nice.
Avatar
Avatar
mgman
Hi there, just join. And got the Ultimate life time package to support your work.
Hi there, thank you for supporting S3Drive!
Avatar
Avatar
mgman
I am very interesed to get be able to store data from the iphone to some remote drive via S3Drive. Thus I heavily support your plan to integrate, iOS mount/files integration. Since I am in desparate need to upload Voice Memos and alike to a secure location.
We're somewhat behind the schedule with iOS mount, we plan to build this integration using most recent Apple framework, so we can also have macOS native mount available. The challenge is there isn't much resource (new approach) and not too many projects implemented that by now. Regardless of these obstacles, it's coming!
Avatar
Avatar
mgman
WHatz I would love to have integrated is the rclone config password, so it asks me for it every time I want to connect to my secure files. As it si setup not if yomebody gets to the dump file one has full access. THis is not nice.
Rclone config encryption is also on the feature list: https://s3drive.canny.io/feature-requests/p/rclone-encrypted-config Regarding security on iOS. Rclone config file is kept in the Library path of the application. It's using native iOS sandbox security, so as long as your device isn't compromised or rooted/jailbreaked (not that we're against of it, but user needs to understand the security implications) you should be fine. We also plan to add lock screen: https://s3drive.canny.io/feature-requests/p/lock-screen-pin-biometric-face-id (edited)
Add support for encrypted Rclone config: https://rclone.org/docs/#configuration-encryption On some OSs there isn't enough isolation between apps, meaning that
Add support for additional app protection to protect user's data and credentials.
👍 1
Lee joined the server. 10/4/2024 8:49 AM
Bear joined the server. 10/4/2024 9:42 AM
Avatar
Avatar
Tom
We're somewhat behind the schedule with iOS mount, we plan to build this integration using most recent Apple framework, so we can also have macOS native mount available. The challenge is there isn't much resource (new approach) and not too many projects implemented that by now. Regardless of these obstacles, it's coming!
Great am looking forward to it!
Avatar
Unlawful Cactus 10/5/2024 3:45 PM
FYI: iOS 18 added the ability to lock any app, see https://support.apple.com/guide/iphone/lock-or-hide-or-an-app-iph00f208d05/ios (edited)
Lock or hide or an app on iPhone so that others can’t see it or view the information in it.
Avatar
Midnight-Soup 10/5/2024 4:24 PM
I'll often hard delete some (Say a directory of < 3) files in a bucket, refresh and they re-appear - could this just be iDrive E2 being a bit rubbish or could I be doing something wrong? (edited)
Anteo joined the server. 10/6/2024 6:40 AM
xomisgod joined the server. 10/6/2024 11:06 AM
Rafal joined the server. 10/6/2024 11:47 AM
Avatar
Avatar
Midnight-Soup
I'll often hard delete some (Say a directory of < 3) files in a bucket, refresh and they re-appear - could this just be iDrive E2 being a bit rubbish or could I be doing something wrong? (edited)
Hi this is related to iDrive E2 not being 100% S3 compatible. Similar issue: https://discord.com/channels/1069654792902815845/1260374351115456615/1260640777596436490 Reported also for MinIO: https://github.com/minio/minio/issues/17810 You could try using: "Delete all items in trash" in your: "Profile settings" which would remove anything that was deleted, but also would delete hidden delete markers (leftovers from hard-delete). In the future we may perform additional API calls (for iDrive E2 and MinIO only) in order to cleanup the left over delete markers. We haven't been doing that, since it's fine for almost all S3 providers and comes at some additional API costs.
Avatar
Avatar
Tom
Hi this is related to iDrive E2 not being 100% S3 compatible. Similar issue: https://discord.com/channels/1069654792902815845/1260374351115456615/1260640777596436490 Reported also for MinIO: https://github.com/minio/minio/issues/17810 You could try using: "Delete all items in trash" in your: "Profile settings" which would remove anything that was deleted, but also would delete hidden delete markers (leftovers from hard-delete). In the future we may perform additional API calls (for iDrive E2 and MinIO only) in order to cleanup the left over delete markers. We haven't been doing that, since it's fine for almost all S3 providers and comes at some additional API costs.
Midnight-Soup 10/7/2024 3:19 PM
Thanks Tom. I suppose I can’t expect much for 19USD a year, the London region often has outages too.
infastin joined the server. 10/7/2024 9:23 PM
BiznatchSprinkles joined the server. 10/9/2024 8:47 AM
Lars joined the server. 10/10/2024 4:54 PM
Avatar
Avatar
Lars
Click to see original message
Avatar
Just updated app and iOS versions and seem to be having an issue when I’m trying to upload to my s3 drive. I can upload files from the s3 drive app but no longer from the other apps. For example from my photos when I select to upload to s3 drive it attempts to it doesn’t launch the s3 drive app. This is happening in other apps that I was able to upload from before. Hope you have some insight.
Avatar
Avatar
avantartist
Just updated app and iOS versions and seem to be having an issue when I’m trying to upload to my s3 drive. I can upload files from the s3 drive app but no longer from the other apps. For example from my photos when I select to upload to s3 drive it attempts to it doesn’t launch the s3 drive app. This is happening in other apps that I was able to upload from before. Hope you have some insight.
Thanks for your feedback! We'll check that out and let you know and/or develop a fix.
👍 1
Avatar
Avatar
avantartist
Just updated app and iOS versions and seem to be having an issue when I’m trying to upload to my s3 drive. I can upload files from the s3 drive app but no longer from the other apps. For example from my photos when I select to upload to s3 drive it attempts to it doesn’t launch the s3 drive app. This is happening in other apps that I was able to upload from before. Hope you have some insight.
We've reproduced the problem and can confirm it's an issue on the newest iOS 18. We'll release a fix likely next week. Thanks for your report!
Avatar
Avatar
Tom
Rclone config encryption is also on the feature list: https://s3drive.canny.io/feature-requests/p/rclone-encrypted-config Regarding security on iOS. Rclone config file is kept in the Library path of the application. It's using native iOS sandbox security, so as long as your device isn't compromised or rooted/jailbreaked (not that we're against of it, but user needs to understand the security implications) you should be fine. We also plan to add lock screen: https://s3drive.canny.io/feature-requests/p/lock-screen-pin-biometric-face-id (edited)
What if we forget our PIN password ,some ways to recovery ?
Avatar
Avatar
mix9311
What if we forget our PIN password ,some ways to recovery ?
You would likely need to retrieve data from a backup. You have one right? 😅 We can restore access to your encrypted raw files (e.g. forgot password feature), but we can't restore your data encryption key, as we never had it in first place. That's the consequence of E2E encryption model. If you feel you're not able to protect your password, then you shouldn't enable E2E encryption, but then you need to be aware there maybe privacy risks in not doing so. That's a classic example of: "You can't have your cake and eat it (too)" conflict. (edited)
Ash_khot_ joined the server. 10/13/2024 3:58 PM
Proxy joined the server. 10/14/2024 2:13 AM
gromov joined the server. 10/15/2024 9:15 PM
Avatar
Good afternoon. Can you please tell me if the APK file can be downloaded somewhere ? Huawei phone no play market
Avatar
Hi, it may depend on Google services so not sure it would work, but I can try to grab it for you
Avatar
@gromov feel free to try it out
👍 1
Avatar
Unlawful Cactus 10/16/2024 10:34 AM
Looks like that's only the base APK, I don't think that works? Here's the split APK containing the following: base.apk split config.arm64_V8a.apk split_config.en.apk split_config.xxhdpi.apk
10:35 AM
O, it exceeds the maximum file size one can send with a free Discord account 😦
Avatar
Unlawful Cactus 10/16/2024 10:45 AM
@gromov Try https://gitlab.com/AuroraOSS/AuroraStore which gets the APKs directly from Google servers (edited)
An unofficial FOSS client to Google Play.
👍 2
Avatar
that's a better idea indeed
Avatar
Avatar
Unlawful Cactus
@gromov Try https://gitlab.com/AuroraOSS/AuroraStore which gets the APKs directly from Google servers (edited)
Thanks, it installed from aurora with no problem. Everything works correctly. But I would still suggest putting the APK file on the website in the “download” section.
Avatar
Unlawful Cactus 10/16/2024 9:48 PM
Not sure what you mean to say with the screenshot, but I guess a VPN either caused it or solved it for you 👍🏻
Avatar
GitLab has likely blocked Ukraine due to the current conflict
Tony Piper joined the server. 10/17/2024 9:54 AM
anderschen joined the server. 10/17/2024 10:15 AM
Avatar
Unlawful Cactus 10/17/2024 11:16 AM
That doesn't make sense to me, but maybe I'm missing a crucial piece of information. Why is that likely?
Avatar
They specifically block the Crimea, Donetsk, and Luhansk regions
👍 1
Arctic joined the server. 10/18/2024 12:47 AM
Avatar
Unlawful Cactus 10/18/2024 10:18 AM
Source or explanation?
Avatar
Source: their website's GitLab Explanation: global sanctions against Russia likely apply to contested territories they (may?) have control over
12:17 PM
I'm far from being a geopolitical expert, so I'm sure you would be able to find better explanations
👍 1
Matt joined the server. 10/19/2024 11:54 PM
Likki joined the server. 10/20/2024 7:45 PM
cromeanator joined the server. 10/21/2024 4:40 AM
Avatar
jovial_quokka_60260 10/21/2024 6:26 PM
rivnfanatic23 joined the server. 10/22/2024 5:15 AM
Avatar
Haven't tried it yet but does s3drive understands encrypted rclone.conf ?
Avatar
Avatar
Ari
Haven't tried it yet but does s3drive understands encrypted rclone.conf ?
Yes, but in a JSON format, not in the native .ini. If you're on desktop you can easily transcode it to ini, e.g. on Linux: cat rclone.conf | jc --ini. If you need path to your Rclone config you can type: rclone config file. If you use any online converter instead, stripy any sensitive parts before pasting data online. Native .ini wil be supported at some point: https://s3drive.canny.io/feature-requests/p/add-support-for-rcloneconf-import-and-ini-format (edited)
At the moment only JSON format and output from: rclone config dump is supported.
Avatar
Avatar
Tom
Yes, but in a JSON format, not in the native .ini. If you're on desktop you can easily transcode it to ini, e.g. on Linux: cat rclone.conf | jc --ini. If you need path to your Rclone config you can type: rclone config file. If you use any online converter instead, stripy any sensitive parts before pasting data online. Native .ini wil be supported at some point: https://s3drive.canny.io/feature-requests/p/add-support-for-rcloneconf-import-and-ini-format (edited)
thank you! waht tool is jc ?
newoutsider joined the server. 10/23/2024 7:22 PM
MR joined the server. 10/24/2024 1:37 AM
Hegz joined the server. 10/24/2024 6:01 PM
TimS3 joined the server. 10/25/2024 8:44 AM
jf joined the server. 10/26/2024 4:01 AM
TheWilley (Souptime) joined the server. 10/26/2024 1:19 PM
Avatar
TheWilley (Souptime) 10/26/2024 1:31 PM
Hi! Been using your app with Backblaze and I must say it works wonders. Incredibly easy to connect my linux OS and android phone. I'm curios however how you guys are doing in terms of development and finance. Will you guys be around in say 2 years? Does 1.99 euro a month (for a subscription) from my side help the longevity of the project? I'm asking because I like your product and want it to be sustainable for you folks :p (edited)
❤️ 2
Abdul Hakim Ghaniy joined the server. 10/26/2024 6:46 PM
Teddy joined the server. 10/27/2024 12:14 PM
Avatar
Hi, how can I update the app to the latest version as the changelog on Windows if I installed it with installer.exe?
Avatar
Avatar
zvan_fox
Hi, how can I update the app to the latest version as the changelog on Windows if I installed it with installer.exe?
Hi, you get the latest version: https://github.com/s3drive/windows-app/releases and then install it. It will override the previous one.
Avatar
nice, thank you!
10:46 AM
Hmm..unfortunately, it did not maintain the settings (I'm not logged in, if it helps)
Avatar
Avatar
TheWilley (Souptime)
Hi! Been using your app with Backblaze and I must say it works wonders. Incredibly easy to connect my linux OS and android phone. I'm curios however how you guys are doing in terms of development and finance. Will you guys be around in say 2 years? Does 1.99 euro a month (for a subscription) from my side help the longevity of the project? I'm asking because I like your product and want it to be sustainable for you folks :p (edited)
Hi, thanks for your kind words! I can only speak from my biased founder / lead dev perspective. Our development is progressing nicely, we release frequent updates: https://github.com/s3drive/windows-app/releases and release major milestones every couple months or so. There is a growing number of feature requests: https://s3drive.canny.io/feature-requests that currently outpace our development tempo, but for us it is a healthy sign of a growing userbase and community. In terms of finance, we've divided our business into two (actually more than that, but for the sake of simplicity let's keep 2) major paths. Software and service. Currently S3Drive is mostly about software that users use to connect to 3rd party storage. Software development is expensive, but we're financing it from the license purchases and subscriptions that we sell. As long as this keeps expanding (which it well does) we'll be able to develiver new and new updates. Since our operational costs are low, even if our revenues are dropping, it doesn't mean we can't provide service. It would just mean that development would slow down, so new shiny features would take slightly longer to appear. The other path that would allow us to grow and finance software development is selling S3Drive with a storage bundle. We plan to release paid storage plans over the next couple months. Profit margins are tiny, but it would allow us to speak to broader public with something you can use with login/e-mail password instead of cryptic API keys. To keep the answer simple. Even though €1.99 is a tiny amount, as long as it's recurring and coming from multiple users, it adds up to an overall development pot that we efficiently use to deliver features...and I am really thankful for your purchase.
Contribute to s3drive/windows-app development by creating an account on GitHub.
Give feedback to the S3Drive team so we can make more informed product decisions. Powered by Canny.
Avatar
Avatar
Tom
Hi, thanks for your kind words! I can only speak from my biased founder / lead dev perspective. Our development is progressing nicely, we release frequent updates: https://github.com/s3drive/windows-app/releases and release major milestones every couple months or so. There is a growing number of feature requests: https://s3drive.canny.io/feature-requests that currently outpace our development tempo, but for us it is a healthy sign of a growing userbase and community. In terms of finance, we've divided our business into two (actually more than that, but for the sake of simplicity let's keep 2) major paths. Software and service. Currently S3Drive is mostly about software that users use to connect to 3rd party storage. Software development is expensive, but we're financing it from the license purchases and subscriptions that we sell. As long as this keeps expanding (which it well does) we'll be able to develiver new and new updates. Since our operational costs are low, even if our revenues are dropping, it doesn't mean we can't provide service. It would just mean that development would slow down, so new shiny features would take slightly longer to appear. The other path that would allow us to grow and finance software development is selling S3Drive with a storage bundle. We plan to release paid storage plans over the next couple months. Profit margins are tiny, but it would allow us to speak to broader public with something you can use with login/e-mail password instead of cryptic API keys. To keep the answer simple. Even though €1.99 is a tiny amount, as long as it's recurring and coming from multiple users, it adds up to an overall development pot that we efficiently use to deliver features...and I am really thankful for your purchase.
TheWilley (Souptime) 10/28/2024 3:56 PM
Thanks for the detailed response! It's great to hear you guys are doing well in terms of development and that my subscription helps out. I noticed that alot of features are locked behind said subscription, which was my primary reason for upgrading, but honestly I would probably give you money even if everything was free, because I now daily drive this service and I want to give you something in return. In any case, I hope the userbase continues to grow, and thanks again for this great service! Cheers!
❤️ 1
MysticZach joined the server. 10/29/2024 8:34 AM
ste joined the server. 10/29/2024 4:52 PM
Sleepy Dog🐶 joined the server. 10/30/2024 8:24 AM
Rebmit joined the server. 10/30/2024 9:51 AM
Coldstorageunit joined the server. 10/31/2024 5:45 PM
Avatar
Good time of day. Will there be an open source?
Avatar
Avatar
gromov
Good time of day. Will there be an open source?
S3Drive codebase, rather unlikely at this stage: https://s3drive.app/faq?q=opensource Being a software provider (not a service provider just yet), this is the hidden sauce that makes us get paid, so we can develop this product. Having said that, we run on open source, contribute back (Rclone encryption: https://github.com/rclone/rclone/pull/8105) and rely on standards compatible with open source (S3: https://github.com/minio/minio). What would you like to achieve, if you've had the source? (edited)
Easily transform any S3, WebDAV or Rclone compatible back-end into your personal encrypted file storage. Drive mount, Sync, Backup, File Versioning, Search. Preview different file formats (pdf, markdown, txt, audio, video)
Kir Skaletski GMT+7 joined the server. 11/1/2024 10:43 AM
konstantin joined the server. 11/2/2024 12:54 PM
test ma,e joined the server. 11/3/2024 3:47 PM
Sthb joined the server. 11/5/2024 7:40 AM
esteve joined the server. 11/5/2024 11:53 AM
motorbikesandchill joined the server. 11/8/2024 4:14 AM
stitch911 joined the server. 11/9/2024 8:19 AM
FliZa joined the server. 11/9/2024 11:48 AM
zewo joined the server. 11/10/2024 5:45 PM
anthigh joined the server. 11/11/2024 8:23 AM
Avatar
Avatar
anthigh
Click to see original message
Sticker
aky joined the server. 11/11/2024 7:38 PM
Wyllis joined the server. 11/13/2024 6:16 PM
Avatar
Hey everyone, do you know, if it is possible to create a public link for a folder? I can create the link for a file, but for a folder I cannot see the option.
Tom joined the server. 11/14/2024 9:15 PM
Avatar
Unlawful Cactus 11/14/2024 10:18 PM
Why did S3Drive migrate on the iOS App Store? Do we need to install the new one and set it up again? Is it safe or a sign of a hostile takeover? Feels weird…
Avatar
@Tom ^^ +1
Avatar
Avatar
Unlawful Cactus
Why did S3Drive migrate on the iOS App Store? Do we need to install the new one and set it up again? Is it safe or a sign of a hostile takeover? Feels weird…
Hi, sorry for not mentioning this well ahead, but we've been talking to Apple about unlinking defunct macOS version from the iOS release for quite some time... and only now got "somewhat approved" at short notice. In the end the only solution to our problem was to remove both iOS/macOS versions, so that's what we did. Once you install new version your in-app purchases won't be visible (unless it was done through our website), so we'll need to have it fixed for you: https://s3drive.app/faq?q=ios_purchase In more detail: The reason that we've had to remove the macOS version from App Store is Apple Sandbox which doesn't work with Rclone making S3Drive unusable (we don't have these restrictions with DMG release). We've started to receive negative feedback, which started to take priority on the product page over iOS release where feedback was mostly positive 4.7/5.0. This started to affect our iOS statistics. We've had hoped that we will be able to unlink macOS from iOS and only unrelease macOS, unfortunately Apple doesn't allow you to do that... so the only option was to remove everything and have a fresh start. It means we yet again need to build the ranking / position and all the reviews, but waiting would only make things worse. I am really sorry for this disruptive change to happen, but it seems it's the only path that allowed us to not look like some abandonware... and it's a shame there was no easier way to do that. (edited)
Easily transform any S3, WebDAV or Rclone compatible back-end into your personal encrypted file storage. Drive mount, Sync, Backup, File Versioning, Search. Preview different file formats (pdf, markdown, txt, audio, video)
Avatar
@Tom , website mentions that the hosted plans are fully S3-compatible, but you don't provide the necessary details to use this storage with other S3-enabled apps. Is the hosted storage meant to be used only within S3Drive, or can it be accessed with a third-party S3-compatible client? If it's intended for external access, could you share the endpoints and instructions for generating the required keys? (edited)
kfcmadthursday joined the server. 11/16/2024 1:01 AM
Deleted User joined the server. 11/16/2024 4:08 AM
Shrac joined the server. 11/16/2024 4:13 AM
Avatar
Avatar
xomisgod
@Tom , website mentions that the hosted plans are fully S3-compatible, but you don't provide the necessary details to use this storage with other S3-enabled apps. Is the hosted storage meant to be used only within S3Drive, or can it be accessed with a third-party S3-compatible client? If it's intended for external access, could you share the endpoints and instructions for generating the required keys? (edited)
The only storage plan that's available is currently free 12GB. Even though behind the scenes technically there is a S3 compatible endpoint, this plan is not meant to be used outside of S3Drive. Paid storage plans (except Starter) will at some point provide a way to export S3 credentials, so they can be used outside. This is briefly outlined in last item of section: "Intended use", in our T&C: https://s3drive.app/terms
👏 1
Avatar
Thanks! Looks like the ultimate plan + my own S3 storage is the way to go
Avatar
how can i change the automatic media backup file location - mines too large with over 2000 photos on!
Avatar
Avatar
Tom
Hi, sorry for not mentioning this well ahead, but we've been talking to Apple about unlinking defunct macOS version from the iOS release for quite some time... and only now got "somewhat approved" at short notice. In the end the only solution to our problem was to remove both iOS/macOS versions, so that's what we did. Once you install new version your in-app purchases won't be visible (unless it was done through our website), so we'll need to have it fixed for you: https://s3drive.app/faq?q=ios_purchase In more detail: The reason that we've had to remove the macOS version from App Store is Apple Sandbox which doesn't work with Rclone making S3Drive unusable (we don't have these restrictions with DMG release). We've started to receive negative feedback, which started to take priority on the product page over iOS release where feedback was mostly positive 4.7/5.0. This started to affect our iOS statistics. We've had hoped that we will be able to unlink macOS from iOS and only unrelease macOS, unfortunately Apple doesn't allow you to do that... so the only option was to remove everything and have a fresh start. It means we yet again need to build the ranking / position and all the reviews, but waiting would only make things worse. I am really sorry for this disruptive change to happen, but it seems it's the only path that allowed us to not look like some abandonware... and it's a shame there was no easier way to do that. (edited)
Unlawful Cactus 11/16/2024 10:25 PM
Thanks for the detailed explanation, appreciate it!
Mark82163 joined the server. 11/17/2024 3:07 PM
Aimekrofral joined the server. 11/17/2024 3:33 PM
zisen77 joined the server. 11/17/2024 5:55 PM
ulf joined the server. 11/17/2024 10:05 PM
mrhizzo joined the server. 11/18/2024 1:42 AM
Yannik joined the server. 11/18/2024 5:15 PM
aw7k joined the server. 11/18/2024 9:25 PM
firmament joined the server. 11/19/2024 1:13 AM
rk joined the server. 11/19/2024 8:21 AM
TaijiTu joined the server. 11/19/2024 10:53 AM
ray_852 joined the server. 11/20/2024 1:45 AM
Campeh joined the server. 11/20/2024 3:21 AM
Avatar
Avatar
Ludwig
Hey everyone, do you know, if it is possible to create a public link for a folder? I can create the link for a file, but for a folder I cannot see the option.
I2rys (安全) 11/22/2024 4:34 AM
It's not possible to folders yet. (edited)
eee3 joined the server. 11/22/2024 2:24 PM
Diego joined the server. 11/24/2024 9:39 PM
Diemox joined the server. 11/24/2024 9:40 PM
jcx joined the server. 11/25/2024 7:24 PM
Lee joined the server. 11/25/2024 8:03 PM
SemiQuasi joined the server. 11/26/2024 1:29 AM
burbley joined the server. 11/26/2024 7:59 PM
Chris joined the server. 11/26/2024 9:44 PM
Bizbee joined the server. 11/27/2024 2:03 AM
Bizbee joined the server. 11/27/2024 2:18 AM
Avatar
Hi, was looking for an iOS app that works with rclone crypt and stumbled upon S3Drive. Just wanted to stop by and say the app is nice and works great so far. Happy to support you all and keep up the good work 👍
❤️ 1
Surfox joined the server. 11/27/2024 6:09 PM
Avatar
Android work profile has different path for file storage, but the Android S3Drive app attempts to download to /storage/emulated/0 even when running inside work profile and therefore fails due to permission issue. Is it possible to just tell the app to download to the "system default download directory" instead of hardcoding the path "/storage/emulated/0"?
👍 1
UmVeadoQualquer joined the server. 11/27/2024 9:52 PM
Avatar
Avatar
Chris
Android work profile has different path for file storage, but the Android S3Drive app attempts to download to /storage/emulated/0 even when running inside work profile and therefore fails due to permission issue. Is it possible to just tell the app to download to the "system default download directory" instead of hardcoding the path "/storage/emulated/0"?
Hi Chris, Thanks for that note. I will pass that to our team for fixing. Chances are we've never tested this with work profiles. Can't promise anything at this stage, but it shouldn't be massively hard to address. I will update you once I know more about that one.
un0r1ginal joined the server. 11/28/2024 12:14 PM
Deleted User joined the server. 11/28/2024 12:40 PM
miki85. joined the server. 11/28/2024 1:17 PM
Avatar
Hi Tom, thanks very much.
Avatar
Avatar
Chris
Hi Tom, thanks very much.
We've included hotfix to get the path to the Downloads from the Android OS directly instead of using hard-coded values. Can you please update your Android version and let us know if this is now solved? (edited)
Avatar
Hi Tom, I can now download single file which is my main use case so my problem is mostly solved. Remote to local sync also works (didn't test before the hotfix). I still notice some issues which I'm not sure are related to work profile. When making a folder with files and sub-folder available offline, it appears success and the folder is shown in the offline tab, but there's no transfer log and none of the files or sub-folder are actually available offline. Download zip doesn't work most of the time. Transfer log says "Null check operator used on a null value" for most files. It happens when I select folder only, files only, or both. And some suggestions: Currently if I select multiple files, I can only download them as a zip file. Could you add an option to download them as separate files? Some Android device allows multiple users, and I guess non-main users may also have different storage path. In the future you may test S3Drive under that environment as well. Thanks again for your help. Didn't expect a fix this quick and that's convincing.
rk joined the server. 11/30/2024 7:15 AM
MaxNovember joined the server. 11/30/2024 5:57 PM
Avatar
Avatar
Chris
Hi Tom, I can now download single file which is my main use case so my problem is mostly solved. Remote to local sync also works (didn't test before the hotfix). I still notice some issues which I'm not sure are related to work profile. When making a folder with files and sub-folder available offline, it appears success and the folder is shown in the offline tab, but there's no transfer log and none of the files or sub-folder are actually available offline. Download zip doesn't work most of the time. Transfer log says "Null check operator used on a null value" for most files. It happens when I select folder only, files only, or both. And some suggestions: Currently if I select multiple files, I can only download them as a zip file. Could you add an option to download them as separate files? Some Android device allows multiple users, and I guess non-main users may also have different storage path. In the future you may test S3Drive under that environment as well. Thanks again for your help. Didn't expect a fix this quick and that's convincing.
I've passed the offline and zip issues as bugs and multiple files download (without zipping), as a feature request. Can't promise anything, but expect some improvements over the next few weeks. Thanks for your feedback!
bigc joined the server. 11/30/2024 7:48 PM
7:52 PM
Does this still get updated?
Avatar
Avatar
bigc
Does this still get updated?
Hi there? If you mean S3Drive, then sure, please visit our changelog: https://s3drive.app/changelog Unless you meant anything else? 🙂
Avatar
Yes, thank you
jacek64 joined the server. 12/1/2024 12:57 PM
Aranea joined the server. 12/2/2024 12:44 AM
KVSR_ANTS joined the server. 12/2/2024 12:51 AM
Avatar
Hello Tom, first of all thanks for your app, I was looking for something like this for a while! I did just install it and it works great. I do have a few questions on the usage though. I am mainly planning to use it as a backup and extension of my iPhone's storage, mainly the photos and videos. I have my own AWS account and set up S3 access, which seems to work fine. However, I am not sure how to best configure S3Drive to backup my photos and videos. Ideally I'd like to maintain the folders/album structure I have on my phone. I tried adding albums and the content gets added to "Automatic Upload", but it looses any album / folder context. Would you have a guide or suggestion on how to do that?
Avatar
Avatar
KVSR_ANTS
Hello Tom, first of all thanks for your app, I was looking for something like this for a while! I did just install it and it works great. I do have a few questions on the usage though. I am mainly planning to use it as a backup and extension of my iPhone's storage, mainly the photos and videos. I have my own AWS account and set up S3 access, which seems to work fine. However, I am not sure how to best configure S3Drive to backup my photos and videos. Ideally I'd like to maintain the folders/album structure I have on my phone. I tried adding albums and the content gets added to "Automatic Upload", but it looses any album / folder context. Would you have a guide or suggestion on how to do that?
Hi, thanks for kind words! The reason that app puts everything to single backup location on iOS is because it tries to deduplicate photos from all selected albums. If there were multiple albums selected and duplicate photo, how do we choose from which album to delete photo and which to keep? Our experience with iOS was that all media that sits in "Recents" album is present in other albums but grouped by some categories e.g. Favorites or Videos. We could technically split it by album (and that's what we actually do on Android), but since most people likely backup main "Recents" album that would unnecessarily create additional directory layer. Having said that, our experience with iOS ecosystem is limited and perhaps we've missed something in our assessment. How do you organize albums on your phone and which one would you like to backup and which don't? ( Not asking for real album names 🙂 ) We're open for improvements.
Avatar
Thanks for the quick response! That makes sense. On my phone I try to organise my photos into non-overlapping slef managed albums, but there are iOS managed albums where photos overlap quite a bit. I suppose the only real option to handle this properly in a generic would be to manage objects / files independent of their metadata (filename, album, annotations, etc) and that may prove to be a bit of a task. I guess what I was after for my case was a way to backup selected albums into specific bucket prefixes. Whether that results in duplicates would be a risk I'd have to take. (I suppose there could be an async process that checks the checksum or filename, or etag, etc across my bucket and reports back any possible duplications) To be honest I haven't spend too much time with this yet. I was just concerned about how I would manage the files on S3 if they are all in the same folder (and what happens if there should be name clashes).
Avatar
Avatar
KVSR_ANTS
Thanks for the quick response! That makes sense. On my phone I try to organise my photos into non-overlapping slef managed albums, but there are iOS managed albums where photos overlap quite a bit. I suppose the only real option to handle this properly in a generic would be to manage objects / files independent of their metadata (filename, album, annotations, etc) and that may prove to be a bit of a task. I guess what I was after for my case was a way to backup selected albums into specific bucket prefixes. Whether that results in duplicates would be a risk I'd have to take. (I suppose there could be an async process that checks the checksum or filename, or etag, etc across my bucket and reports back any possible duplications) To be honest I haven't spend too much time with this yet. I was just concerned about how I would manage the files on S3 if they are all in the same folder (and what happens if there should be name clashes).
We will certainly be improving app support for managing/backing up assets, however we need to find unified way that works on all platforms and is compatible with E2E encryption (that proves to be challenging). We're working with external project maintainers to introduce certain foundation (e.g. support for secure encrypted file hashing - https://github.com/rclone/rclone/issues/7192) that we could then reliably use for e.g. photo deduplication. Speaking for filenames, these are retrieved directly from iOS: https://developer.apple.com/documentation/photokit/phassetresource/1623985-originalfilename if there may be any collision it's hard for us to tell. To be on the safe side you could enable versioning in your bucket, so if there was any unlike event of collision you would then be to retrieve the previous overwritten version.
Avatar
Yes, thanks for the info!
Ovi joined the server. 12/3/2024 7:48 PM
Avatar
Avatar
Ovi
Click to see original message
X1Aaron joined the server. 12/4/2024 1:49 AM
Avatar
Hi @Ovi, glad to see you here!
👍 1
8:44 AM
Hi @X1Aaron, thanks for joining!
Avatar
Avatar
Tom
Hi @X1Aaron, thanks for joining!
Thanks I’m a lifetime member 🙂
❤️ 1
Avatar
Avatar
X1Aaron
Thanks I’m a lifetime member 🙂
That's brilliant, thank you for supporting the project! If you have any questions, feature ideas or bug reports, I would be glad to assist.
Avatar
Unlawful Cactus 12/4/2024 3:18 PM
Something weird's happening on Android with version 1.10.4 (10100402). I noticed an icon I hadn't seen before in the S3 accounts screen next to my S3Drive account and it leads to a session list. When I end an old session everything seems to be fine, but this is probably where things break. The session is removed from the list, but when I then try to remove another one I get an error message, see screenshot. Then when I want to browse the files in the S3Drive storage it says there's a session issue, see second screenshot. After logging out and back in I can browse my files again, but in the session list the deleted session is once again listed. When I end an old session everything happens again as described.
Avatar
Avatar
Unlawful Cactus
Something weird's happening on Android with version 1.10.4 (10100402). I noticed an icon I hadn't seen before in the S3 accounts screen next to my S3Drive account and it leads to a session list. When I end an old session everything seems to be fine, but this is probably where things break. The session is removed from the list, but when I then try to remove another one I get an error message, see screenshot. Then when I want to browse the files in the S3Drive storage it says there's a session issue, see second screenshot. After logging out and back in I can browse my files again, but in the session list the deleted session is once again listed. When I end an old session everything happens again as described.
Hi, thanks for your report. We've already addressed this issue and will include in a next release within a couple days. The bug is that no matter which session you delete, it always deletes the actual session instead of one you selected. Not great, but next release will address that. (edited)
Avatar
Unlawful Cactus 12/4/2024 3:25 PM
Ah, makes sense, it did cross my mind the first time: “Did I actually delete my current session by accident?” 🤔 Good to know you're already aware and have a fix coming! 🚀
👍 1
Avatar
I tried to use the Windows client, but got an error when trying to login. "HandshakeException: Handshake error in client (OS Error: CERTIFICATE_VERIFY_FAILED: unable to get local issuer certificate(../../../flutter/third_party/boringssl/src/ssl/handshake.cc:393))" Got the the error on both the installer and the Microsoft Store version.
Avatar
Hi @Chris, what's your S3 endpoint? This error happens usually when your endpoint is using expired or self-signed certificate. If it's self-signed (or corporate) then you would need to import it to the S3Drive to make it trusted first. (edited)
Avatar
Hi Tom, It happens when signing in my S3Drive account. No external S3 endpoint was involved, and I've never modified or imported any certificates on my Windows 10 installation.
knovytsk joined the server. 12/6/2024 8:53 AM
taisau joined the server. 12/6/2024 2:35 PM
Isco joined the server. 12/6/2024 4:03 PM
Isco joined the server. 12/6/2024 10:03 PM
Nolol joined the server. 12/6/2024 11:55 PM
pj joined the server. 12/7/2024 2:19 PM
knovytsk joined the server. 12/7/2024 4:36 PM
knovytsk joined the server. 12/7/2024 4:44 PM
otzibrod joined the server. 12/7/2024 5:03 PM
ChaseMalaste joined the server. 12/8/2024 3:28 AM
Avatar
Hi Tom, I understand its easy to attribute this kind of error as user fault, but I've tried to make a fresh installation of Windows 11 24H2 and got the same error when trying to login my S3Drive account, and I doubt its my network either because I could login on Android without issue. Could you please take a look at your Windows version (and maybe other computer versions) and confirm they're working properly with S3Drive account? I wish my lifetime ultimate license won't become useless.
Avatar
Avatar
Chris
Hi Tom, I understand its easy to attribute this kind of error as user fault, but I've tried to make a fresh installation of Windows 11 24H2 and got the same error when trying to login my S3Drive account, and I doubt its my network either because I could login on Android without issue. Could you please take a look at your Windows version (and maybe other computer versions) and confirm they're working properly with S3Drive account? I wish my lifetime ultimate license won't become useless.
Hi @Chris, I've DM'd you with one thing to check on your end. Given that most of our users (Windows included) can login to S3Drive just fine we have reasonable grounds to suspect that issue might be related to your network connection on your desktop. Given that you've tried to set it up on a fresh Windows and still facing this issue, perhaps there is some proxy configuration on your router that may affect this? You've tried on Android and it works fine, can you make sure that Android connects to same Wifi/router that your desktop (in other words can you disable mobile/cellular plan?)
Avatar
Avatar
Chris
I tried to use the Windows client, but got an error when trying to login. "HandshakeException: Handshake error in client (OS Error: CERTIFICATE_VERIFY_FAILED: unable to get local issuer certificate(../../../flutter/third_party/boringssl/src/ssl/handshake.cc:393))" Got the the error on both the installer and the Microsoft Store version.
@Tom for reference, this is exactly the same error that I am confronted with on my project
Maileen joined the server. 12/8/2024 4:56 PM
Avatar
Hi Tom, Thanks very much for getting back. You might be right that it was indeed a networking issue, so I did some testings just now and was finally able to sign in on the Windows client. I'm not sure what the root cause was, but the certificate error previously mentioned no longer occur after enabling encrypted DNS via Cloudflare on the OS level (simply using Cloudflare DNS without encryption doesn't help). On Windows 11 I switched my DNS to the Cloudflare ones and enabled DNS over HTTPS in Settings. On Windows 10 I installed and enabled Cloudflare WARP. I've been using Private DNS on Android which may explain why the Android client works for me. Other encrypted DNS providers may work as well but I didn't test them. I chose Cloudflare simply because the addresses are easy to remember. The Android device connects to the same wifi network as my computer. As far as I know there isn't any proxy or VPN set on the router level. Would still send you the other requested information via DM in case you need them for further diagnosis.
👍 1
Overfeed Unpleased joined the server. 12/9/2024 4:32 AM
Milaina joined the server. 12/9/2024 1:35 PM
AlexMarin joined the server. 12/9/2024 3:34 PM
teenybets joined the server. 12/9/2024 7:30 PM
Avatar
hey - new here, just checking out the product, and was wondering if it would be suitable for "nas-like" use cases. For ex, having a shared "drive" across computers that is theoretically unlimited in size.
weetnuniks joined the server. 12/10/2024 8:10 AM
Avatar
Avatar
teenybets
hey - new here, just checking out the product, and was wondering if it would be suitable for "nas-like" use cases. For ex, having a shared "drive" across computers that is theoretically unlimited in size.
Hi! Sure, once you enable network mount in the settings it shall be available for other machines to connect. Would any other users except the S3Drive mount also modify files on that remote server? If there are any other users (outside mount) using the resource at the same time, you should probably use Writes caching mode (available in Profile settings), otherwise you could use either Writes or Full to speed up reads for other users using mount, as files would be cached locally. At the moment the cache size is limited to 1024M, but in the future depending on user's input we could make this param configurable. If your connection is fast enough (and your remote server is close), then you might not even need the cache, as operations would be fast enough. I would be keen to know if such setup works for you. If you have any other questions regarding S3Drive, I would be glad to help.
Avatar
Avatar
Tom
Hi! Sure, once you enable network mount in the settings it shall be available for other machines to connect. Would any other users except the S3Drive mount also modify files on that remote server? If there are any other users (outside mount) using the resource at the same time, you should probably use Writes caching mode (available in Profile settings), otherwise you could use either Writes or Full to speed up reads for other users using mount, as files would be cached locally. At the moment the cache size is limited to 1024M, but in the future depending on user's input we could make this param configurable. If your connection is fast enough (and your remote server is close), then you might not even need the cache, as operations would be fast enough. I would be keen to know if such setup works for you. If you have any other questions regarding S3Drive, I would be glad to help.
Ideally yes I’d allow more users to use it, each in their own folder within the b2 bucket. So what would you recommend for caching mode? I guess my concern is just what happens when conflicting saves of for ex a file being edited on two computers - I don’t foresee that being common but want to understand failure cases
3:01 PM
And question about purchasing - do I need to purchase multiple licenses, one for each user I’m planning to use the software?
Avatar
Avatar
teenybets
Ideally yes I’d allow more users to use it, each in their own folder within the b2 bucket. So what would you recommend for caching mode? I guess my concern is just what happens when conflicting saves of for ex a file being edited on two computers - I don’t foresee that being common but want to understand failure cases
If users have their own folder within the B2 bucket, then there isn't risk of collision. If users are using same folder, then answer is little bit more complicated. You would be mostly fine, if all users are connected to this folder through a single point of entry, that is mount. There can't be any external users, scripts, actions writing to this folder outside of mount simply because mount itself wouldn't be aware of changes and would overwrite them. Finally, on Backblaze you may want to enable versioning and set up lifecycle policy (E.g. delete all versions older than 90 days). In such case if overwrite was to happen, you would still have plenty time to restore older version (this can be easily done through S3Drive). In order to set up mount, you would need just a single license. Other users would simply connect to this mount, that you've shared over network. If you want to get your hands dirty, you can replicate this configuration without S3Drive using: https://rclone.org/commands/rclone_mount/ as this is what we're using behind the scenes. What's your platform/OS by the way? (edited)
Mount the remote as file system on a mountpoint.
Avatar
I’d need this to be cross platform, Linux/macOS/windows
Avatar
Avatar
teenybets
I’d need this to be cross platform, Linux/macOS/windows
Mount can be set up on any platform, the thing is that it's not recommended/supported to mount same bucket more than one time, as this would lead to unwanted collisions (when two different users open same file, modify and then save back). The only way to make this work is to share the mount over network, but due to performance reasons this would be applicable to local networks only.
Avatar
Avatar
shy
I really like this app , I wanted to know I haven noticed that if I buy lifetime for all platforms google drive is supported. it means that it will be also supported on the Android version ?
Hi again @shy, @Philippe This is to let you know that we've managed to implement Google Drive support on iOS, this will be addressed in a next release within a couple days. (edited)
Zak Web joined the server. 12/12/2024 1:38 AM
Avatar
Avatar
Zak Web
Click to see original message
1:39 AM
👋
Avatar
Unlawful Cactus 12/13/2024 10:46 AM
Hi, recently it stands out to me that the space usage bar is red on my rclone host while I'm not even using 10% of available space, see screenshot. Is this a bug? On my S3Drive space, where I'm only using a few kilobytes, it's light grey.
Avatar
Avatar
Unlawful Cactus
Hi, recently it stands out to me that the space usage bar is red on my rclone host while I'm not even using 10% of available space, see screenshot. Is this a bug? On my S3Drive space, where I'm only using a few kilobytes, it's light grey.
It does look like a bug. This bar isn't complex, but we need to maintain at least 3 different implementations (Rclone, S3 and Managed S3) each of them having own quirks. We will check that out and include fix in one of the next releases. Thanks!
DuckFaceUSA joined the server. 12/14/2024 6:58 AM
imagineD joined the server. 12/14/2024 1:27 PM
Arwen joined the server. 12/14/2024 4:58 PM
Avatar
Question about IOS album syncing. Maybe this is only an issue with very large photo albums. My wife's media backup just spins for 10ish minutes and never shows folder to be able to sync. The app can see them and I can upload individual files. However it just refuses to see the files for media syncing. I installed the new s3drive app from the app store a bit ago and setup my e2 storage again but it still won't work. Also found that the syncing won't let me choose local folders anymore. Any direction would be helpful!
Avatar
Avatar
cromeanator
Question about IOS album syncing. Maybe this is only an issue with very large photo albums. My wife's media backup just spins for 10ish minutes and never shows folder to be able to sync. The app can see them and I can upload individual files. However it just refuses to see the files for media syncing. I installed the new s3drive app from the app store a bit ago and setup my e2 storage again but it still won't work. Also found that the syncing won't let me choose local folders anymore. Any direction would be helpful!
In a next release we'll include dependency updates around media management library and permission management library, this will likely solve this issue. If not, then we'll keep debugging. (edited)
Kevin0 joined the server. 12/16/2024 9:12 AM
Avatar
Avatar
Tom
In a next release we'll include dependency updates around media management library and permission management library, this will likely solve this issue. If not, then we'll keep debugging. (edited)
Awesome thanks for the info Tom!
Mus'ab Ibn Umayr joined the server. 12/18/2024 10:41 AM
Ismaeel joined the server. 12/20/2024 4:25 PM
ari joined the server. 12/22/2024 9:00 PM
Avatar
Hello! I'm interested in buying the lifetime license and am wondering if there's any discounts for purchasing multiple licenses?
Avatar
Avatar
retweak
Hello! I'm interested in buying the lifetime license and am wondering if there's any discounts for purchasing multiple licenses?
Hi! Not anything out of the box, but if you send us quick message: support at s3drive.app (or DM me directly) with some numbers we would certainly be able to get you some discount. Thanks! (edited)
Avatar
Merry Christmas. Hate to report what I believe is a bug today, but I believe there is a bug in the latest version v1.11.0 where the "Quit" in the tray icon on Windows won't close the app.
Avatar
Avatar
timecaster
Merry Christmas. Hate to report what I believe is a bug today, but I believe there is a bug in the latest version v1.11.0 where the "Quit" in the tray icon on Windows won't close the app.
Hi @timecaster, thanks for your report. We've confirmed that is the case and our reindeer team is now helping to get it resolved. There are rumors that this is related to the new functionality of minimizing the app to the taskbar. In the meantime please either use "Force close" if you would like to quit the app or fallback to the previous 1.10.5 release. Thanks!
Avatar
Avatar
timecaster
Merry Christmas. Hate to report what I believe is a bug today, but I believe there is a bug in the latest version v1.11.0 where the "Quit" in the tray icon on Windows won't close the app.
This shall be now addressed in a 1.11.0+1 release, please give it a go and let us know. Thanks!
Avatar
I am happy to see that I'm not forced to update S3 Drive whenever I open it 😄
11:16 AM
and that I can just acknowledge and move on
11:16 AM
Happy New Year Tom 😄
Exported 2,852 message(s)
Timezone: UTC+0